'No applications Found' in Monitor Applications Table

Questions about YourKit Java Profiler
Locked
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

'No applications Found' in Monitor Applications Table

Post by JohnnyC »

I just downloaded the latest evaluation 2021.11.b227. I have installed the libyjpagent.so file onto 3 linux servers. When I attempt to connect to them I am only able to successfully connect to 1 of the 3. When I select "Profile remote Java EE server or application...." and enter the server name for the 2nd or 3rd server and entry is created in the "Monitor Applications" table but under that entry it says "No applications found". In contrast "tomcat" appears for the entry that to which I can connect.

I've been using YourKit for over 15 years and I've tried everything I know to check. I assume it is some dumb mistake that I've made but I'm at a lost. The attached file profiler-ui-14688.log is from the system running the client. The tomcat-12563.log is from one of the linux server to which I'm unable to connect.

In catalina.out of the server to which I can't connect I see the following line which I assume proves that I'm running the correct version of the library.
[YourKit Java Profiler 2021.11-b227] Log file: /home/icmuser/.yjp/log/tomcat-10124.log
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

Re: 'No applications Found' in Monitor Applications Table

Post by JohnnyC »

JohnnyC wrote: Mon Mar 14, 2022 7:09 pm I just downloaded the latest evaluation 2021.11.b227. I have installed the libyjpagent.so file onto 3 linux servers. When I attempt to connect to them I am only able to successfully connect to 1 of the 3. When I select "Profile remote Java EE server or application...." and enter the server name for the 2nd or 3rd server and entry is created in the "Monitor Applications" table but under that entry it says "No applications found". In contrast "tomcat" appears for the entry that to which I can connect.

I've been using YourKit for over 15 years and I've tried everything I know to check. I assume it is some dumb mistake that I've made but I'm at a lost. The attached file profiler-ui-14688.log is from the system running the client. The tomcat-12563.log is from one of the linux server to which I'm unable to connect.

In catalina.out of the server to which I can't connect I see the following line which I assume proves that I'm running the correct version of the library.
[YourKit Java Profiler 2021.11-b227] Log file: /home/icmuser/.yjp/log/tomcat-10124.log
I apologize I'm having problems attaching the log files.
I have run the following command on the "good" server and one of the "bad" servers.
curl -k -X POST https://localhost:10001/yjp/api/v1/getStatus

Good Server Results:
{
"allocationRecording" : false,
"asyncSamplingCpu" : false,
"callCounting" : false,
"cpuProfiling" : false,
"deadlockDetected" : false,
"exceptionProfiling" : true,
"monitorProfiling" : false,
"pid" : 4186,
"sampling" : false,
"sessionName" : "tomcat",
"stackTelemetry" : true,
"tracing" : false
}

Bad Server Results:
{
"allocationRecording" : false,
"asyncSamplingCpu" : false,
"callCounting" : false,
"cpuProfiling" : false,
"deadlockDetected" : false,
"exceptionProfiling" : true,
"monitorProfiling" : false,
"pid" : 12562,
"sampling" : false,
"sessionName" : "tomcat",
"stackTelemetry" : true,
"tracing" : false
}
Vladimir Kondratyev
Posts: 1619
Joined: Tue Aug 10, 2004 7:52 pm

Re: 'No applications Found' in Monitor Applications Table

Post by Vladimir Kondratyev »

1) Make sure that you can reach agent with "curl -k -X POST https://foobar:10001/yjp/api/v1/getStatus" command from the host where you run profiler UI.

2) Do you use "simple" or "advanced" discovery method? https://www.yourkit.com/docs/java/help/ ... ote_ui.jsp
In simple method "listen=all" must be specified https://www.yourkit.com/docs/java/help/ ... jsp#listen

3) Please try to specify port explicitly instead of port range.

4) Check proxy configuration https://www.yourkit.com/docs/java/help/proxy.jsp
Please try to select "no proxy" instead of "automatic"
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

Re: 'No applications Found' in Monitor Applications Table

Post by JohnnyC »

Vladimir:

Thank you so much for your assistance, I was able to resolve the issue with your instructions. In case anyone else finds this issue:
- I was able to get the correct output by executing the curl command from the client server
- I have always used simple method. In fact I have connected to the problematic server with an older version of yourkit many times using the simple method. However I used the advanced method and I can now connect to the problematic server with this version of yourkit. I simply had to provide the ssh username and password along with the path to the java executable on the server.

Thanks again!
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

Re: 'No applications Found' in Monitor Applications Table

Post by JohnnyC »

Apparently I declared victory a little too quickly. When I attempt to capture a memory snapshot on the problematic server I receive an error. The following exception appears several times in the log file on the client/ui server:
" commandLine: "-Dsys.synchdb.autorun=FULL" coymmandLine: "-Dsys.actekapplicationsroot=/apps/Disk1/Actek" commandLine: "-XX:HeapDumpPath=/apps/Disk1/DUMP" commandLine: "-XX:+DisableExplicitGC" commandLine: "-XX:+PrintGCTimeStamps" commandLine: "-XX:+PrintGCDateStamps" commandLine: "-XX:+PrintGCDetails" commandLine: "-XX:+PrintReferenceGC" commandLine: "-XX:+PrintTenuringDistribution" commandLine: "-Xloggc:/apps/Disk1/Actek/GClogs/tomcat-icmgc.log" commandLine: "-XX:+UseGCLogFileRotation" commandLine: "-XX:NumberOfGCLogFiles=10" commandLine: "-XX:GCLogFileSize=1M" commandLine: "-Dignore.endorsed.dirs=" commandLine: "-classpath" commandLine: "/apps/tomcat/bin/bootstrap.jar:/apps/tomcat/bin/tomcat-juli.jar" commandLine: "-Dcatalina.base=/apps/tomcat" commandLine: "-Dcatalina.home=/apps/tomcat" commandLine: "-Djava.io.tmpdir=/apps/tomcat-tmp" commandLine: "org.apache.catalina.startup.Bootstrap" commandLine: "start" platform: "linux-x86-64" telemetryLimit: 3600; }: com.yourkit.controller.b: Cannot communicate with https://127.0.0.1:51500
at com.yourkit.controller.g.a(a:40)
at com.yourkit.controller.c.gp(a:129)
at com.yourkit.controller.c.a(a:937)
at com.yourkit.i.r.ad(a:1736)
at com.yourkit.am.ad.d.a.f(a:296)
at com.yourkit.am.ad.d.a.e(a:237)
at com.yourkit.am.ad.d.a.ahw(a:129)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)

I will begin looking for the solution myself, but if you have any advice I would appreciate it.
Vladimir Kondratyev
Posts: 1619
Joined: Tue Aug 10, 2004 7:52 pm

Re: 'No applications Found' in Monitor Applications Table

Post by Vladimir Kondratyev »

It is strange that all your URLs look like "https://127.0.0.1:some_port". Do you run "curl" on the same machine where agent runs? You have to make sure that "curl" work on the machine where profiler UI runs.

Most probable agent listens on loopback interface 127.0.0.1 (default option), so the port is not accessible from network. To fix this please add "listen=all" to agent options as described here https://www.yourkit.com/docs/java/help/ ... jsp#listen
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

Re: 'No applications Found' in Monitor Applications Table

Post by JohnnyC »

Vladimir:

Thank you again. For the record I was able to run the curl command from the both the agent (where the application I'm trying to profile lives) and from the profiler UI.

Adding the listen=all parameter to the properties string on the agent has resolved the problem, but unfortunately I've hit another problem. This new problem isn't a blocker like the others, but if you have any ideas I would love to hear them.

So adding listen=all does result in the Java processes showing up in the "Monitor Applications" table. I am now able to connect to all three of my servers. I am able to successfully take CPU snapshots on all three servers. However taking a memory snapshot only works on 2 of the 3 servers. On the problematic server, it gets about 25% complete and then issues an error dialog saying "Cannot communicate with https://callidusqaapp5:10001". Note that the dump file IS CREATED on the agent server. So I am able to ssh into that machine, manually transfer it to the yourkit server and then open it...thus this is not a blocker.

The problematic server (the same one that has given me problems thus far) has the biggest heap of the three agent servers. It has 18GB while the other two have 16GB and 8GB. However when I attempt to take the snapshots, the server has just been restarted, so only 2-3GB is being used. The dump file that is created is 2.9GB. Additionally the server running the YourKit UI has 160GB of ram of which I have 64GB allocated to YourKit via the Xmx setting in the ui file.

When the error occurs there are no new messages written to the YourKit ui log file (C:\Users\jclark\.yjp\log\profiler-ui-14688). On the agent machine the following 14 lines are written to the (/home/thesecretuserid/.yjp/log/tomcat-14925)

Code: Select all

21.11-227 1393.815: [m: 24652 8617] WSN: starting /apps/Disk1/DUMP/tomcat-2022-03-16-4.snapshot
21.11-227 1393.815: WSN: generation to be advanced...
21.11-227 1402.562: [m: 24652 8621] WSN: generation advanced
21.11-227 1402.733: [m: 24652 8622] WSN: tables written
21.11-227 1402.733: [m: 24652 8622] WSN: starting heap...
21.11-227 1420.987: [m: 24652 8625] WSN: classes...
21.11-227 1421.871: [m: 24652 8655] WSN: loaded classes: 23143
21.11-227 1423.571: [m: 24652 8655] WSN: tagged classes: 23327
21.11-227 1423.586: [m: 24652 8655] WSN: additional class infos: 185
21.11-227 1423.630: [m: 24799 8803] WSN: tagCount=38704666
21.11-227 1432.435: [m: 24799 8802] WSN: ITH 1 done
21.11-227 1432.472: [m: 24799 8802] WSN: heap segment...
21.11-227 1432.483: [m: 24799 8802] WSN: classes dumped
21.11-227 1447.934: [m: 25095 9098] WSN: O+OA done
Any ideas? If not I still GREATLY appreciate the assistance!
Vladimir Kondratyev
Posts: 1619
Joined: Tue Aug 10, 2004 7:52 pm

Re: 'No applications Found' in Monitor Applications Table

Post by Vladimir Kondratyev »

Note that the dump file IS CREATED on the agent server. So I am able to ssh into that machine, manually transfer it to the yourkit server and then open it...thus this is not a blocker.
This is a networking issue. Please try to add "-Dyk.wsLongReadTimeout=200000" (200 sec. 60s is a default) and "-Dyk.wsShortReadTimeout=60000" (60 sec, 10s is a default) to ~/.yjp/ui.ini file. It will increase socket timeouts.
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

Re: 'No applications Found' in Monitor Applications Table

Post by JohnnyC »

Thanks again, unfortunately I think I was premature in saying that the file is created successfully. That was true when the Heap was fairly empty and the .snapshot file was a few GB. However when the amount of heap approaches 10 GB I get the error and an invalid file is created (2KB .snapshot). Additionally I tested after adding the new properties to the ui properties file. In this latest test prior to using YourKit I used jmap to create an hprof and it was 16GB. Again to clarify I have ALSO replicated the problem with YourKit without using jmap. Thanks again for all the incredible help!
Anton Katilin
Posts: 6172
Joined: Wed Aug 11, 2004 8:37 am

Re: 'No applications Found' in Monitor Applications Table

Post by Anton Katilin »

Hi,

If these are the last lines in the agent log file
21.11-227 1432.472: [m: 24799 8802] WSN: heap segment...
21.11-227 1432.483: [m: 24799 8802] WSN: classes dumped
21.11-227 1447.934: [m: 25095 9098] WSN: O+OA done
and the process is no longer running (terminates), the JVM has likely crashed.

Is there hs_err<pid>.log crash file created by the JVM?

Anyway, using the HPROF dumper to create a memory snapshot is a good approach for dumping large heaps. Please note that the same code works inside the JVM no matter how you trigger the dump, e.g. by using the HPROF option from the profiler UI or by using tools like jmap.

https://www.yourkit.com/docs/java/help/ ... pshots.jsp
JohnnyC
Posts: 8
Joined: Thu Mar 10, 2011 8:15 pm

Re: 'No applications Found' in Monitor Applications Table

Post by JohnnyC »

Anton:
First of all thank you for taking the time to help me. I just recreated the problem and here is the new content written to the YourKit ui log file (C:\Users\jclark\.yjp\log\profiler-ui-15292)

Code: Select all

21.11-227 21393.361: WARNING: com.yourkit.am.g.ae$a: Cannot get progress; Cannot communicate with https://callidusqaapp5:10001: com.yourkit.controller.b: Cannot communicate with https://callidusqaapp5:10001
	at com.yourkit.controller.g.a(a:40)
	at com.yourkit.controller.c.a(a:709)
	at com.yourkit.controller.c.gQ(a:1135)
	at com.yourkit.am.g.ae$a.run(a:129)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)

21.11-227 21438.186: ERROR: com.yourkit.controller.b.r: An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception.: java.io.IOException: An existing connection was forcibly closed by the remote host
	at java.base/sun.nio.ch.SocketDispatcher.read0(Native Method)
	at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43)
	at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
	at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:233)
	at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:356)
	at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
	at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:151)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.lang.Thread.run(Thread.java:829)

21.11-227 21438.187: WARNING: com.yourkit.am.g.ae$a: Cannot get progress; Cannot communicate with https://callidusqaapp5:10001: com.yourkit.controller.b: Cannot communicate with https://callidusqaapp5:10001
	at com.yourkit.controller.g.a(a:40)
	at com.yourkit.controller.c.a(a:709)
	at com.yourkit.controller.c.gQ(a:1135)
	at com.yourkit.am.g.ae$a.run(a:129)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)

21.11-227 21438.188: com.yourkit.am.ad.d.a: Update failed; attempt=1; controller=com.yourkit.controller.c@41d8bc44{transport=null; state=DISCONNECTED; agentInfo=agentVersion: "YourKit Java Profiler 2021.11-b227" capabilities: 524608 sessionGuid: "129164199010654" sessionName: "tomcat" snapshotNameFormat: "{sessionname}-{date}" hostId: "360261994943ZZV257UW5ZWU7099999999" snapshotDir: "/apps/Disk1/DUMP" pid: 30073 user: "icmuser" commandLine: "/apps/java/bin/java" commandLine: "-Djava.util.logging.config.file=/apps/tomcat/conf/logging.properties" commandLine: "-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager" commandLine: "-Djdk.tls.ephemeralDHKeySize=2048" commandLine: "-Dorg.apache.catalina.security.SecurityListener.UMASK=0027" commandLine: "-agentlib:yjpagent=sessionname=tomcat,dir=/apps/Disk1/DUMP,listen=all" commandLine: "-Xms16504m" commandLine: "-Xmx16504m" commandLine: "-Dsun.rmi.dgc.client.gcInterval=3600000" commandLine: "-Dsun.rmi.dgc.server.gcInterval=3600000" commandLine: "-Dsys.env.level=TEST" commandLine: "-Dsys.synchdb.autorun=FULL" commandLine: "-Dsys.actekapplicationsroot=/apps/Disk1/Actek" commandLine: "-XX:HeapDumpPath=/apps/Disk1/DUMP" commandLine: "-XX:+DisableExplicitGC" commandLine: "-XX:+PrintGCTimeStamps" commandLine: "-XX:+PrintGCDateStamps" commandLine: "-XX:+PrintGCDetails" commandLine: "-XX:+PrintReferenceGC" commandLine: "-XX:+PrintTenuringDistribution" commandLine: "-Xloggc:/apps/Disk1/Actek/GClogs/tomcat-icmgc.log" commandLine: "-XX:+UseGCLogFileRotation" commandLine: "-XX:NumberOfGCLogFiles=10" commandLine: "-XX:GCLogFileSize=1M" commandLine: "-Dignore.endorsed.dirs=" commandLine: "-classpath" commandLine: "/apps/tomcat/bin/bootstrap.jar:/apps/tomcat/bin/tomcat-juli.jar" commandLine: "-Dcatalina.base=/apps/tomcat" commandLine: "-Dcatalina.home=/apps/tomcat" commandLine: "-Djava.io.tmpdir=/apps/tomcat-tmp" commandLine: "org.apache.catalina.startup.Bootstrap" commandLine: "start" platform: "linux-x86-64" telemetryLimit: 3600; }
21.11-227 21442.213: com.yourkit.am.ad.d.a: Update failed; attempt=2; controller=com.yourkit.controller.c@41d8bc44{transport=null; state=DISCONNECTED; agentInfo=agentVersion: "YourKit Java Profiler 2021.11-b227" capabilities: 524608 sessionGuid: "129164199010654" sessionName: "tomcat" snapshotNameFormat: "{sessionname}-{date}" hostId: "360261994943ZZV257UW5ZWU7099999999" snapshotDir: "/apps/Disk1/DUMP" pid: 30073 user: "icmuser" commandLine: "/apps/java/bin/java" commandLine: "-Djava.util.logging.config.file=/apps/tomcat/conf/logging.properties" commandLine: "-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager" commandLine: "-Djdk.tls.ephemeralDHKeySize=2048" commandLine: "-Dorg.apache.catalina.security.SecurityListener.UMASK=0027" commandLine: "-agentlib:yjpagent=sessionname=tomcat,dir=/apps/Disk1/DUMP,listen=all" commandLine: "-Xms16504m" commandLine: "-Xmx16504m" commandLine: "-Dsun.rmi.dgc.client.gcInterval=3600000" commandLine: "-Dsun.rmi.dgc.server.gcInterval=3600000" commandLine: "-Dsys.env.level=TEST" commandLine: "-Dsys.synchdb.autorun=FULL" commandLine: "-Dsys.actekapplicationsroot=/apps/Disk1/Actek" commandLine: "-XX:HeapDumpPath=/apps/Disk1/DUMP" commandLine: "-XX:+DisableExplicitGC" commandLine: "-XX:+PrintGCTimeStamps" commandLine: "-XX:+PrintGCDateStamps" commandLine: "-XX:+PrintGCDetails" commandLine: "-XX:+PrintReferenceGC" commandLine: "-XX:+PrintTenuringDistribution" commandLine: "-Xloggc:/apps/Disk1/Actek/GClogs/tomcat-icmgc.log" commandLine: "-XX:+UseGCLogFileRotation" commandLine: "-XX:NumberOfGCLogFiles=10" commandLine: "-XX:GCLogFileSize=1M" commandLine: "-Dignore.endorsed.dirs=" commandLine: "-classpath" commandLine: "/apps/tomcat/bin/bootstrap.jar:/apps/tomcat/bin/tomcat-juli.jar" commandLine: "-Dcatalina.base=/apps/tomcat" commandLine: "-Dcatalina.home=/apps/tomcat" commandLine: "-Djava.io.tmpdir=/apps/tomcat-tmp" commandLine: "org.apache.catalina.startup.Bootstrap" commandLine: "start" platform: "linux-x86-64" telemetryLimit: 3600; }
21.11-227 21446.247: com.yourkit.am.ad.d.a: Update failed; attempt=3; controller=com.yourkit.controller.c@41d8bc44{transport=null; state=DISCONNECTED; agentInfo=agentVersion: "YourKit Java Profiler 2021.11-b227" capabilities: 524608 sessionGuid: "129164199010654" sessionName: "tomcat" snapshotNameFormat: "{sessionname}-{date}" hostId: "360261994943ZZV257UW5ZWU7099999999" snapshotDir: "/apps/Disk1/DUMP" pid: 30073 user: "icmuser" commandLine: "/apps/java/bin/java" commandLine: "-Djava.util.logging.config.file=/apps/tomcat/conf/logging.properties" commandLine: "-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager" commandLine: "-Djdk.tls.ephemeralDHKeySize=2048" commandLine: "-Dorg.apache.catalina.security.SecurityListener.UMASK=0027" commandLine: "-agentlib:yjpagent=sessionname=tomcat,dir=/apps/Disk1/DUMP,listen=all" commandLine: "-Xms16504m" commandLine: "-Xmx16504m" commandLine: "-Dsun.rmi.dgc.client.gcInterval=3600000" commandLine: "-Dsun.rmi.dgc.server.gcInterval=3600000" commandLine: "-Dsys.env.level=TEST" commandLine: "-Dsys.synchdb.autorun=FULL" commandLine: "-Dsys.actekapplicationsroot=/apps/Disk1/Actek" commandLine: "-XX:HeapDumpPath=/apps/Disk1/DUMP" commandLine: "-XX:+DisableExplicitGC" commandLine: "-XX:+PrintGCTimeStamps" commandLine: "-XX:+PrintGCDateStamps" commandLine: "-XX:+PrintGCDetails" commandLine: "-XX:+PrintReferenceGC" commandLine: "-XX:+PrintTenuringDistribution" commandLine: "-Xloggc:/apps/Disk1/Actek/GClogs/tomcat-icmgc.log" commandLine: "-XX:+UseGCLogFileRotation" commandLine: "-XX:NumberOfGCLogFiles=10" commandLine: "-XX:GCLogFileSize=1M" commandLine: "-Dignore.endorsed.dirs=" commandLine: "-classpath" commandLine: "/apps/tomcat/bin/bootstrap.jar:/apps/tomcat/bin/tomcat-juli.jar" commandLine: "-Dcatalina.base=/apps/tomcat" commandLine: "-Dcatalina.home=/apps/tomcat" commandLine: "-Djava.io.tmpdir=/apps/tomcat-tmp" commandLine: "org.apache.catalina.startup.Bootstrap" commandLine: "start" platform: "linux-x86-64" telemetryLimit: 3600; }: com.yourkit.controller.b: Cannot communicate with https://callidusqaapp5:10001
	at com.yourkit.controller.g.a(a:40)
	at com.yourkit.controller.c.gp(a:129)
	at com.yourkit.controller.c.a(a:937)
	at com.yourkit.i.r.ad(a:1736)
	at com.yourkit.am.ad.d.a.f(a:296)
	at com.yourkit.am.ad.d.a.e(a:237)
	at com.yourkit.am.ad.d.a.ahw(a:129)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)

21.11-227 21446.248: com.yourkit.am.ad.d.a: Terminate DB update loop
Here is the new content written to the log file on the agent machine (/home/thesecretuserid/.yjp/log/tomcat-30073)

Code: Select all

21.11-227 20115.770: warning: long telemetry sample: 343 ms (333/10)
21.11-227 20229.614: [m: 23501 18175] WSN: starting /apps/Disk1/DUMP/tomcat-2022-03-17-1.snapshot
21.11-227 20229.615: WSN: generation to be advanced...
And yes, the crash killed the java process running on the agent (the one I'm trying to profile). The only hs_err*.log file on the server is from a year ago.

I haven't done a side by side comparison, but it seems like the HPROF format provides limited info. Therefore I'd prefer to only use it when I absolutely have to. Additionally as I mentioned previously I've been using YourKit for 15+ years, and yes I've seen it crash the JVM during this type of operation on a large JVM, but with previous versions of YourKit those crashes occurred rarely. Again I greatly appreciate the help.
Anton Katilin
Posts: 6172
Joined: Wed Aug 11, 2004 8:37 am

Re: 'No applications Found' in Monitor Applications Table

Post by Anton Katilin »

What is the output of "java -version" for the problematic JVM?
the crash killed the java process running on the agent (the one I'm trying to profile). The only hs_err*.log file on the server is from a year ago.
If you are able to reproduce the problem, please try to set the hs_err file location explicitly with -XX:ErrorFile
https://stackoverflow.com/questions/800 ... -log-files
By default it's created in the working directory of the JVM process or in the temporary directory if cannot be created in the working directory.
it seems like the HPROF format provides limited info.
HPROF does not contain YourKit specific profiling information such as telemetry, but this can be obtained by additionally capturing a performance snapshot.
Unless you use object allocation recording and are interested in allocations of particular objects in the heap, HPROF should be generally equal to YourKit memory snapshot in presenting the heap state.
Locked