Use -XX:+PrintGCDetails -Xloggc:D:\GcStats\gc.log -XX:+HeapDumpOnOutOfMemoryError
parameter in JAVA_OPTS(in run.sh/bat) while starting the JBoss to get HEAPDUMP.
U can use CTRL+BRK if Jboss started from command line and kill -3 <Jboss Service pid> in Unix.