Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGX: Firmware detected lockup (0) (pid=542)
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_ta_channel.cpp:317:getHardwareDiagnosisReport: TA channel timeout. Dumping registers:
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=127):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=97):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:490:restart: - flagging context <ptr> on entry <ptr> as affected by HW restart
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=96):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:490:restart: - flagging context <ptr> on entry <ptr> as guilty for HW restart
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=127):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=9):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=8):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=127):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=1):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=0):
Oct 14 17:15:57 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:15:57 iThiago kernel[0] <Notice>: GPU hang: Firmware Detected Lockup
Oct 14 17:15:57 iThiago kernel[0] <Notice>: Trying restart GPU ...
Oct 14 17:15:57 iThiago locationd[60] <Notice>: SecTaskLoadEntitlements failed error=22
Oct 14 17:16:00 iThiago kernel[0] <Notice>: able:
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Stack_top 252 Stamp Current 2438241
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GART_id 0 AGXGart <ptr> Gart Physical Base 0x83e512000 UsageStamp 0 StackEntry 255
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GART_id 1 AGXGart <ptr> Gart Physical Base 0x826490000 UsageStamp 2438239 StackEntry 254
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GART_id 2 AGXGart 0 Gart Physical Base 0x0 UsageStamp 403664 StackEntry 253
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GART_id 3 AGXGart <ptr> Gart Physical Base 0x835990000 UsageStamp 2438241 StackEntry 252
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Fw: GART_id Table:
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GART_TABLE[0]: CTX_id (ta, 3d, cl, fw) 255, 255, 255, 0 CATBASE_PA 0x83e512000
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GART_TABLE[3]: CTX_id (ta, 3d, cl, fw) 1, 1, 1, 1 CATBASE_PA 0x835990000
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Firmware CATBASE_id Table:
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Firmware Stack_top 5 usagestamp_current 44263
Oct 14 17:16:00 iThiago kernel[0] <Notice>: CATBASE_TABLE[0]: GART_id 0 refcnt 1
Oct 14 17:16:00 iThiago kernel[0] <Notice>: CATBASE_TABLE[1]: GART_id 3 refcnt 1
Oct 14 17:16:00 iThiago kernel[0] <Notice>: RGX_CR_BIF_MMU_ENTRY 0x0000000000000002	RGX_CR_BIF_MMU_ENTRY_STATUS 0x0000000000000000
Oct 14 17:16:00 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:00 iThiago kernel[0] <Notice>: USC Pipe 0 State Overview
Oct 14 17:16:00 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:00 iThiago kernel[0] <Notice>: RGX_CR_USC_DM_SLOT0 0xFFFFFFFFFFFFFFFF	ents for channel (stamp_idx=97):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:490:restart: - flagging context <ptr> on entry <ptr> as affected by HW restart
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:490:restart: - flagging context <ptr> on entry <ptr> as affected by HW restart
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=96):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:490:restart: - flagging context <ptr> on entry <ptr> as guilty for HW restart
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:490:restart: - flagging context <ptr> on entry <ptr> as guilty for HW restart
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=127):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=9):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=8):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=127):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=1):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:461:restart: 
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Pruning events for channel (stamp_idx=0):
Oct 14 17:16:00 iThiago kernel[0] <Notice>: AGXk: agxk_channel.cpp:469:restart: Ring is empty and all finished. Nothing to do.
Oct 14 17:16:00 iThiago kernel[0] <Notice>: GPU hang: Firmware Detected Lockup
Oct 14 17:16:00 iThiago kernel[0] <Notice>: Trying restart GPU ...
Oct 14 17:16:01 iThiago pasteboardd[547] <Notice>: SecTaskLoadEntitlements failed error=22
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGXk: agxk_accelerator.h:834:regPoll32: Timed out waiting for register 0x03C8 (read 0x0000007A) (elapsed_time_ms: 3000, value: 0x00000004, mask: 0x00000004)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: virtual bool AGXMetaFirmware::waitForMetaIdle(): Poll on SIDEKICK_IDLE timed out! (0x7a)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Firmware was not stopped for inspection cleanly. GPU & firmware state unknown...
Oct 14 17:16:04 iThiago kernel[0] <Notice>: =====================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Firmware State: 
Oct 14 17:16:04 iThiago kernel[0] <Notice>: =====================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: PState: 0	 SubPState: 0	 DC: 3f800000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===========================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Full Register Dump:
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===========================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0000: 0x0aaaaa002a2aaaaa 0x0000000001700068
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0018: 0x00000000011b0403 0x0000000000014600 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000205d2d
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0050: 0x0000000000000000 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x00e0: 0x0000000000000000 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0100: 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0118: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0158: 0x0000000000000000 0x00000000003f9764 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0198: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000001 0x0000000000000000 0x0000000000000000 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0200: 0x0000000000000000 0x0000000000000000 0x0000000100840000 0x0000000000000000 0x0000005f00000060
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0230: 0x0000000000000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 0x0240: 0x0000000100848100 0x0000000100a89e00 0x0000000000000000 0x0000000000000000========================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: USC Pipe 2 State Overview
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_DM_SLOT0 0xFFFFFFFFFFFFFFFF	RGX_CR_USC_DM_SLOT1 0x00000000FFFFFFFF
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_SERV_PIXEL 0x0000000000010000	RGX_CR_USC_SERV_TESS_PIXEL 0x0000000000010000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_SERV_VERTEX 0x0000000000010000	RGX_CR_USC_SERV_TESS_VERTEX 0x0000000000010000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_SERV_COMPUTE 0x0000000000010000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: USC Pipe 3 State Overview
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_DM_SLOT0 0xFFFFFFFFFFFFFFFF	RGX_CR_USC_DM_SLOT1 0x00000000FFFFFFFF
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_SERV_PIXEL 0x0000000000010000	RGX_CR_USC_SERV_TESS_PIXEL 0x0000000000010000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_SERV_VERTEX 0x0000000000010000	RGX_CR_USC_SERV_TESS_VERTEX 0x0000000000010000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_USC_SERV_COMPUTE 0x0000000000010000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: META Register State Overview
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_META_SP_MSLVIRQSTATUS 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: RGX_CR_META_BOOT 0x00000001
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T0ENABLE 0x0201C036
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T0STATUS 0x00030008 (no error)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T0DEFR 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T0INTERN0 0x00141100
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T0 PC  0x1000E190 (PC of waiting for BG kick = 0x10027D28)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T0 PCX 0x100133C4
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T1ENABLE 0x0201C132
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T1STATUS 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T1DEFR 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T1INTERN0 0x001C7070
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T1 PC  0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: T1 PCX 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ====== Firmware run configuration ======
Oct 14 17:16:04 iThiago kernel[0] <Notice>: pdump mode = disabled
Oct 14 17:16:04 iThiago kernel[0] <Notice>: GPU tracing = disabled
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Idle detection = enabled
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Transfer Overrides Power: 0	Performance: 0	Overall: 0
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Timer context switching = 0
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ============ Firmware event ring ============
Oct 14 17:16:04 iThiago kernel[0] <Notice>: No outstanding firmware events
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ============ Firmware log ring ============
Oct 14 17:16:04 iThiago kernel[0] <Notice>: No outstanding firmware logs
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ============ Firmware trace ring ============
Oct 14 17:16:04 iThiago kernel[0] <Notice>: No outstanding trace logs
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ====== Fender State ======
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGX_CR_FNDR_TIMER_SLEEP_CONTROL = 0x40000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGX_CR_FNDR_TIMER_KICK_STATUS = 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGX_CR_FNDR_TIMER_POWER_INT_ENABLE = 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGX_CR_FNDR_TIMER_POWER_INT_STATUS = 0x00000003
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGX_CR_FNDR_VCM_PERF_STATE_CONTROL = 0x00000001
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGX_CR_FNDR_VCM_PERFORMANCE_NEXT_STATE = 0x00000000
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: Firmware Addresses:
Oct 14 17:16:04 iThiago kernel[0] <Notice>: ===================
Oct 14 17:16:04 iThiago kernel[0] <Notice>: TA_RING_STATUS 0xc02471c0 TA_RING 0xc02472c0 TA_RINGENTRY_SIZE(dwords) 0x4
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 3D_RING_STATUS 0xc0247200 3D_RING 0xc02482c0 3D_RINGENTRY_SIZE(dwords) 0x4
Oct 14 17:16:04 iThiago kernel[0] <Notice>: CL_RING_STATUS 0xc0247240 CL_RING 0xc02492c0 CL_RINGENTRY_SIZE(dwords) 0x4
Oct 14 17:16:04 iThiago kernel[0] <Notice>: DEVICE_RING_STATUS 0xc0247280 DEVICE_RING 0xc024a2c0 DEVICE_RINGENTRY_SIZE(dwords) 0x4
Oct 14 17:16:04 iThiago kernel[0] <Notice>: -----
Oct 14 17:16:04 iThiago kernel[0] <Notice>: DataMaster:
Oct 14 17:16:04 iThiago kernel[0] <Notice>: TA 0x500882c0
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 3d 0x50088640
Oct 14 17:16:04 iThiago kernel[0] <Notice>: CL 0x50088a40
Oct 14 17:16:04 iThiago kernel[0] <Notice>: -----
Oct 14 17:16:04 iThiago kernel[0] <Notice>: TA State 0x500884c4 SubState 0x500884c8
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 3D State 0x50088854
Oct 14 17:16:04 iThiago kernel[0] <Notice>: CL State 0x50088c40
Oct 14 17:16:04 iThiago kernel[0] <Notice>: -----
Oct 14 17:16:04 iThiago kernel[0] <Notice>: TA Submit List 0x500884e4 Size: 84 (dwords)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: 3D Submit List 0x50088874 Size: 84 (dwords)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: CL Submit List 0x50088c5c Size: 84 (dwords)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGXk: agxk_event_machine.cpp:193:forceCompleteAllStamps: void AGXEventMachine::forceCompleteAllStamps() - Updated stamp 96 (1 -> 3)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGXk: agxk_event_machine.cpp:193:forceCompleteAllStamps: void AGXEventMachine::forceCompleteAllStamps() - Updated stamp 97 (1 -> 3)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: AGXk: agxk_restart_report.cpp:145:finish: void AGXRestartReport::finish(): Could not send GPUResetReport to CrashReporter (kr=268435459)
Oct 14 17:16:04 iThiago kernel[0] <Notice>: GPU restart complete.