求助......16.04显卡深度学习训练到半夜自动重启

系统安装、升级讨论
版面规则
我们都知道新人的确很菜,也喜欢抱怨,并且带有浓厚的Windows习惯,但既然在这里询问,我们就应该有责任帮助他们解决问题,而不是直接泼冷水、简单的否定或发表对解决问题没有任何帮助的帖子。乐于分享,以人为本,这正是Ubuntu的精神所在。
回复
q6121223
帖子: 6
注册时间: 2019-03-16 13:41
系统: Ubuntu 16.04 LTS

求助......16.04显卡深度学习训练到半夜自动重启

#1

帖子 q6121223 » 2019-03-16 14:19

系统Ubantu16.04,用来跑计算机视觉方面的深度学习算法,原始代码在出现重启问题前在本台电脑上已经跑过很多次都没有任何问题,但是大概从10天前,加了一些代码后开始出现训练至半夜重启的现象,一开始不以为意,结果之后每天训练都会发生重启,导致模型根本到不了收敛状态,刚开始怀疑自己加的代码存在内存泄漏导致内存问题重启,注释掉相关代码使用原始代码后,同样重启情况依然出现,奇怪的是,在出现此情况之前原始代码在这台电脑上的运行没有任何问题,结果现在也不行了。
在网上查找各种重启崩溃日志都没有找到崩溃原因,故来此请教有没有懂得大神能赐教一下!! 不胜感激 :Cry
PS:之前电脑上不存在message.log 特地去etc的rsyslog.conf下取消注释后才有的

下附wtmp崩溃记录 和相关auth.log syslog kern.log 和messages(从中挑选了16号半夜(最近一次)和15号半夜两次崩溃记录相关日志:)
wtmp重启&崩溃记录:
kw tty7 :0 Sat Mar 16 09:54 gone - no logout
reboot system boot 4.15.0-46-generi Sat Mar 16 02:35 still running
kw tty7 :0 Fri Mar 15 17:21 - crash (09:14)
reboot system boot 4.15.0-46-generi Fri Mar 15 17:20 still running
kw tty7 :0 Fri Mar 15 16:40 - down (00:39)
reboot system boot 4.15.0-46-generi Fri Mar 15 02:39 - 17:20 (14:40)
kw tty7 :0 Thu Mar 14 18:40 - crash (07:58)
reboot system boot 4.15.0-46-generi Thu Mar 14 18:40 - 17:20 (22:40)
kw tty7 :0 Thu Mar 14 17:26 - crash (01:14)
reboot system boot 4.15.0-46-generi Thu Mar 14 12:43 - 17:20 (1+04:36)
kw tty7 :0 Wed Mar 13 23:02 - crash (13:41)
reboot system boot 4.15.0-46-generi Wed Mar 13 22:54 - 17:20 (1+18:26)
kw tty7 :0 Wed Mar 13 09:24 - crash (13:29)
reboot system boot 4.15.0-46-generi Wed Mar 13 08:44 - 17:20 (2+08:36)
kw tty7 :0 Wed Mar 13 05:39 - crash (03:04)
reboot system boot 4.15.0-46-generi Wed Mar 13 05:39 - 17:20 (2+11:41)
kw tty7 :0 Tue Mar 12 11:04 - crash (18:35)
reboot system boot 4.15.0-46-generi Tue Mar 12 11:03 - 17:20 (3+06:16)
kw tty7 :0 Tue Mar 12 10:55 - crash (00:08)
reboot system boot 4.15.0-46-generi Tue Mar 12 10:54 - 17:20 (3+06:25)
kw tty7 :0 Tue Mar 12 10:39 - crash (00:15)
reboot system boot 4.15.0-46-generi Tue Mar 12 10:38 - 17:20 (3+06:42)
kw tty7 :0 Mon Mar 11 23:13 - crash (11:24)
reboot system boot 4.15.0-46-generi Mon Mar 11 23:13 - 17:20 (3+18:07)
kw tty7 :0 Mon Mar 11 14:24 - crash (08:49)
reboot system boot 4.15.0-46-generi Sun Mar 10 23:50 - 17:20 (4+17:30)
kw tty7 :0 Sun Mar 10 21:28 - crash (02:21)
reboot system boot 4.15.0-46-generi Sun Mar 10 19:52 - 17:20 (4+21:28)
kw tty7 :0 Sat Mar 9 20:27 - crash (23:25)
reboot system boot 4.15.0-46-generi Sat Mar 9 13:56 - 17:20 (6+03:23)
kw tty7 :0 Fri Mar 8 11:46 - crash (1+02:10)
reboot system boot 4.15.0-46-generi Fri Mar 8 11:46 - 17:20 (7+05:34)
kw tty7 :0 Thu Mar 7 16:03 - crash (19:43)
reboot system boot 4.15.0-46-generi Thu Mar 7 16:02 - 17:20 (8+01:18)
kw tty7 :0 Wed Mar 6 21:55 - crash (18:07)
reboot system boot 4.15.0-45-generi Wed Mar 6 21:54 - 17:20 (8+19:26)
kw tty7 :0 Wed Mar 6 17:35 - down (04:19)
reboot system boot 4.15.0-45-generi Wed Mar 6 17:31 - 21:54 (04:22)
kw tty7 :0 Tue Mar 5 10:51 - down (1+06:39)
reboot system boot 4.15.0-45-generi Tue Mar 5 08:00 - 17:30 (1+09:30)
kw tty7 :0 Mon Mar 4 14:07 - crash (17:53)
reboot system boot 4.15.0-45-generi Mon Mar 4 03:51 - 17:30 (2+13:39)
kw tty7 :0 Sun Mar 3 19:56 - crash (07:55)
reboot system boot 4.15.0-45-generi Sun Mar 3 14:18 - 17:30 (3+03:12)
reboot system boot 4.15.0-45-generi Sun Mar 3 14:16 - 17:30 (3+03:14)
kw tty7 :0 Sat Mar 2 18:49 - crash (19:26)
reboot system boot 4.15.0-45-generi Sat Mar 2 18:49 - 17:30 (3+22:41)
kw tty7 :0 Sat Mar 2 13:10 - crash (05:39)
reboot system boot 4.15.0-45-generi Sat Mar 2 10:44 - 17:30 (4+06:46)


——————————————————————————16号日志-崩溃时间(Sat Mar 16 02:35)——————————————————————————:
****************************************auth.log************************************************:
Mar 15 23:17:01 kw-desktop CRON[5005]: pam_unix(cron:session): session closed for user root
Mar 15 23:53:59 kw-desktop smbd: pam_unix(samba:session): session closed for user nobody
Mar 15 23:54:02 kw-desktop smbd: pam_unix(samba:session): session closed for user nobody
Mar 16 00:17:01 kw-desktop CRON[6627]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 16 00:17:01 kw-desktop CRON[6627]: pam_unix(cron:session): session closed for user root
Mar 16 01:17:01 kw-desktop CRON[7764]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 16 01:17:01 kw-desktop CRON[7764]: pam_unix(cron:session): session closed for user root
Mar 16 02:17:01 kw-desktop CRON[8902]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 16 02:17:01 kw-desktop CRON[8902]: pam_unix(cron:session): session closed for user root
Mar 16 02:36:02 kw-desktop systemd-logind[756]: New seat seat0.
Mar 16 02:36:02 kw-desktop systemd-logind[756]: Watching system buttons on /dev/input/event1 (Power Button)
Mar 16 02:36:02 kw-desktop systemd-logind[756]: Watching system buttons on /dev/input/event0 (Power Button)
Mar 16 02:36:07 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet.so): /lib/security/pam_kwallet.so: cannot open shared object file: No such file or directory
Mar 16 02:36:07 kw-desktop lightdm: PAM adding faulty module: pam_kwallet.so
Mar 16 02:36:07 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet5.so): /lib/security/pam_kwallet5.so: cannot open shared object file: No such file or directory
Mar 16 02:36:07 kw-desktop lightdm: PAM adding faulty module: pam_kwallet5.so
Mar 16 02:36:07 kw-desktop lightdm: pam_unix(lightdm-greeter:session): session opened for user lightdm by (uid=0)
Mar 16 02:36:07 kw-desktop systemd: pam_unix(systemd-user:session): session opened for user lightdm by (uid=0)
Mar 16 02:36:07 kw-desktop systemd-logind[756]: New session c1 of user lightdm.
Mar 16 02:36:08 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet.so): /lib/security/pam_kwallet.so: cannot open shared object file: No such file or directory
Mar 16 02:36:08 kw-desktop lightdm: PAM adding faulty module: pam_kwallet.so
Mar 16 02:36:08 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet5.so): /lib/security/pam_kwallet5.so: cannot open shared object file: No such file or directory
Mar 16 02:36:08 kw-desktop lightdm: PAM adding faulty module: pam_kwallet5.so
Mar 16 02:36:08 kw-desktop lightdm: pam_succeed_if(lightdm:auth): requirement "user ingroup nopasswdlogin" not met by user "kw"
Mar 16 02:36:33 kw-desktop dbus[732]: [system] Failed to activate service 'org.bluez': timed out
Mar 16 03:17:01 kw-desktop CRON[1627]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 16 03:17:01 kw-desktop CRON[1627]: pam_unix(cron:session): session closed for user root
Mar 16 04:17:01 kw-desktop CRON[1646]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 16 04:17:01 kw-desktop CRON[1646]: pam_unix(cron:session): session closed for user root
Mar 16 05:17:01 kw-desktop CRON[2006]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 16 05:17:01 kw-desktop CRON[2006]: pam_unix(cron:session): session closed for user root
****************************************syslog************************************************:
Mar 15 22:32:56 kw-desktop org.gnome.Terminal[1421]: (gnome-terminal-server:3656): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 15 23:17:01 kw-desktop CRON[5006]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 15 23:31:40 kw-desktop dbus[752]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
Mar 15 23:31:40 kw-desktop systemd[1]: Starting Hostname Service...
Mar 15 23:31:40 kw-desktop dbus[752]: [system] Successfully activated service 'org.freedesktop.hostname1'
Mar 15 23:31:40 kw-desktop systemd[1]: Started Hostname Service.
Mar 16 00:17:01 kw-desktop CRON[6628]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 16 01:17:01 kw-desktop CRON[7765]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 16 02:17:01 kw-desktop CRON[8903]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 16 02:36:02 kw-desktop rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="776" x-info="http://www.rsyslog.com"] start
Mar 16 02:36:02 kw-desktop rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Mar 16 02:36:02 kw-desktop rsyslogd: rsyslogd's groupid changed to 108
Mar 16 02:36:02 kw-desktop rsyslogd: rsyslogd's userid changed to 104
Mar 16 02:36:02 kw-desktop rsyslogd-2039: Could not open output pipe '/dev/xconsole':: No such file or directory [v8.16.0 try http://www.rsyslog.com/e/2039 ]
Mar 16 02:36:02 kw-desktop rsyslogd-2007: action 'action 12' suspended, next retry is Sat Mar 16 02:36:32 2019 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Mar 16 02:36:02 kw-desktop systemd-modules-load[249]: Inserted module 'lp'
Mar 16 02:36:02 kw-desktop systemd-modules-load[249]: Inserted module 'ppdev'
Mar 16 02:36:02 kw-desktop systemd-modules-load[249]: Inserted module 'parport_pc'
Mar 16 02:36:02 kw-desktop systemd[1]: Started Apply Kernel Variables.
Mar 16 02:36:02 kw-desktop loadkeys[255]: Loading /etc/console-setup/cached.kmap.gz
Mar 16 02:36:02 kw-desktop systemd[1]: Started Set console keymap.
Mar 16 02:36:02 kw-desktop ureadahead[250]: ureadahead:/var/spool/cups/tmp/cups-dbus-notifier-lockfile: No such file or directory
Mar 16 02:36:02 kw-desktop systemd[1]: Started udev Kernel Device Manager.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Remount Root and Kernel File Systems...
Mar 16 02:36:02 kw-desktop systemd[1]: Started Remount Root and Kernel File Systems.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting udev Coldplug all Devices...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Load/Save Random Seed...
Mar 16 02:36:02 kw-desktop systemd[1]: Reached target Local File Systems (Pre).
Mar 16 02:36:02 kw-desktop systemd[1]: Reached target Local File Systems.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Clean up any mess left by 0dns-up...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Set console font and keymap...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Tell Plymouth To Write Out Runtime Data...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting LSB: AppArmor initialization...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Flush Journal to Persistent Storage...
Mar 16 02:36:02 kw-desktop systemd[1]: Started Load/Save Random Seed.
Mar 16 02:36:02 kw-desktop systemd[1]: Started Clean up any mess left by 0dns-up.
Mar 16 02:36:02 kw-desktop systemd[1]: Started Flush Journal to Persistent Storage.

****************************************messages.log************************************************:
Mar 15 22:32:56 kw-desktop org.gnome.Terminal[1421]: (gnome-terminal-server:3656): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 15 23:17:01 kw-desktop CRON[5006]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 15 23:31:40 kw-desktop dbus[752]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
Mar 15 23:31:40 kw-desktop systemd[1]: Starting Hostname Service...
Mar 15 23:31:40 kw-desktop dbus[752]: [system] Successfully activated service 'org.freedesktop.hostname1'
Mar 15 23:31:40 kw-desktop systemd[1]: Started Hostname Service.
Mar 16 00:17:01 kw-desktop CRON[6628]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 16 01:17:01 kw-desktop CRON[7765]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 16 02:17:01 kw-desktop CRON[8903]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 16 02:36:02 kw-desktop rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="776" x-info="http://www.rsyslog.com"] start
Mar 16 02:36:02 kw-desktop rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Mar 16 02:36:02 kw-desktop rsyslogd: rsyslogd's groupid changed to 108
Mar 16 02:36:02 kw-desktop rsyslogd: rsyslogd's userid changed to 104
Mar 16 02:36:02 kw-desktop rsyslogd-2039: Could not open output pipe '/dev/xconsole':: No such file or directory [v8.16.0 try http://www.rsyslog.com/e/2039 ]
Mar 16 02:36:02 kw-desktop rsyslogd-2007: action 'action 12' suspended, next retry is Sat Mar 16 02:36:32 2019 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Mar 16 02:36:02 kw-desktop systemd-modules-load[249]: Inserted module 'lp'
Mar 16 02:36:02 kw-desktop systemd-modules-load[249]: Inserted module 'ppdev'
Mar 16 02:36:02 kw-desktop systemd-modules-load[249]: Inserted module 'parport_pc'
Mar 16 02:36:02 kw-desktop systemd[1]: Started Apply Kernel Variables.
Mar 16 02:36:02 kw-desktop loadkeys[255]: Loading /etc/console-setup/cached.kmap.gz
Mar 16 02:36:02 kw-desktop systemd[1]: Started Set console keymap.
Mar 16 02:36:02 kw-desktop ureadahead[250]: ureadahead:/var/spool/cups/tmp/cups-dbus-notifier-lockfile: No such file or directory
Mar 16 02:36:02 kw-desktop systemd[1]: Started udev Kernel Device Manager.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Remount Root and Kernel File Systems...
Mar 16 02:36:02 kw-desktop systemd[1]: Started Remount Root and Kernel File Systems.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting udev Coldplug all Devices...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Load/Save Random Seed...
Mar 16 02:36:02 kw-desktop systemd[1]: Reached target Local File Systems (Pre).
Mar 16 02:36:02 kw-desktop systemd[1]: Reached target Local File Systems.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Clean up any mess left by 0dns-up...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Set console font and keymap...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Tell Plymouth To Write Out Runtime Data...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting LSB: AppArmor initialization...
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Flush Journal to Persistent Storage...
Mar 16 02:36:02 kw-desktop systemd[1]: Started Load/Save Random Seed.
Mar 16 02:36:02 kw-desktop systemd[1]: Started Clean up any mess left by 0dns-up.
Mar 16 02:36:02 kw-desktop systemd[1]: Started Flush Journal to Persistent Storage.
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Create Volatile Files and Directories...
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] microcode: microcode updated early to revision 0x20, date = 2018-04-10
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Linux version 4.15.0-46-generic (buildd@lgw01-amd64-008) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)) #49~16.04.1-Ubuntu SMP Tue Feb 12 17:45:24 UTC 2019 (Ubuntu 4.15.0-46.49~16.04.1-generic 4.15.18)
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.15.0-46-generic root=UUID=4915f1ea-5f81-4fd0-b2ab-ad094aa2d00c ro quiet splash vt.handoff=7
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] KERNEL supported cpus:
Mar 16 02:36:02 kw-desktop systemd[1]: Starting Nameserver information manager...
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Intel GenuineIntel
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] AMD AuthenticAMD
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Centaur CentaurHauls
Mar 16 02:36:02 kw-desktop systemd-tmpfiles[324]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
Mar 16 02:36:02 kw-desktop systemd[1]: Started Nameserver information manager.
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/fpu: Enabled xstate features 0x3, context size is 576 bytes, using 'standard' format.
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: BIOS-provided physical RAM map:
Mar 16 02:36:02 kw-desktop systemd[1]: Reached target Network (Pre).

****************************************kern.log************************************************:
Mar 15 18:55:37 kw-desktop kernel: [ 5692.343741] usb 2-1.4: Manufacturer: Rapoo
Mar 15 18:55:37 kw-desktop kernel: [ 5692.347121] input: Rapoo Rapoo Gaming Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/0003:24AE:4005.0009/input/input15
Mar 15 18:55:37 kw-desktop kernel: [ 5692.407338] hid-generic 0003:24AE:4005.0009: input,hidraw2: USB HID v1.10 Keyboard [Rapoo Rapoo Gaming Keyboard] on usb-0000:00:1d.0-1.4/input0
Mar 15 18:55:37 kw-desktop kernel: [ 5692.412508] input: Rapoo Rapoo Gaming Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/0003:24AE:4005.000A/input/input16
Mar 15 18:55:38 kw-desktop kernel: [ 5692.471300] hid-generic 0003:24AE:4005.000A: input,hiddev1,hidraw3: USB HID v1.10 Mouse [Rapoo Rapoo Gaming Keyboard] on usb-0000:00:1d.0-1.4/input1
Mar 15 18:55:38 kw-desktop kernel: [ 5692.473611] hid-generic 0003:24AE:4005.000B: hiddev2,hidraw4: USB HID v1.10 Device [Rapoo Rapoo Gaming Keyboard] on usb-0000:00:1d.0-1.4/input2
Mar 15 19:00:02 kw-desktop kernel: [ 5956.711618] perf: interrupt took too long (3145 > 3133), lowering kernel.perf_event_max_sample_rate to 63500
Mar 15 19:46:16 kw-desktop kernel: [ 8731.336416] perf: interrupt took too long (3940 > 3931), lowering kernel.perf_event_max_sample_rate to 50750
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] microcode: microcode updated early to revision 0x20, date = 2018-04-10
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Linux version 4.15.0-46-generic (buildd@lgw01-amd64-008) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)) #49~16.04.1-Ubuntu SMP Tue Feb 12 17:45:24 UTC 2019 (Ubuntu 4.15.0-46.49~16.04.1-generic 4.15.18)
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.15.0-46-generic root=UUID=4915f1ea-5f81-4fd0-b2ab-ad094aa2d00c ro quiet splash vt.handoff=7
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] KERNEL supported cpus:
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Intel GenuineIntel
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] AMD AuthenticAMD
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Centaur CentaurHauls
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/fpu: Enabled xstate features 0x3, context size is 576 bytes, using 'standard' format.
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: BIOS-provided physical RAM map:
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009d7ff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009d800-0x000000000009ffff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000de214fff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de215000-0x00000000de823fff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de824000-0x00000000de8aefff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de8af000-0x00000000de94bfff] ACPI NVS
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de94c000-0x00000000deed4fff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000deed5000-0x00000000deed5fff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000deed6000-0x00000000def18fff] ACPI NVS
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000def19000-0x00000000df5c5fff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000df5c6000-0x00000000df7f1fff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000df7f2000-0x00000000df7fffff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed03fff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000021effffff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] NX (Execute Disable) protection: active
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] SMBIOS 2.7 present.
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] DMI: To Be Filled By O.E.M. To Be Filled By O.E.M./H61M-VS4, BIOS P1.40 07/12/2013
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: last_pfn = 0x21f000 max_arch_pfn = 0x400000000
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] MTRR default type: uncachable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] MTRR fixed ranges enabled:
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 00000-9FFFF write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] A0000-BFFFF uncachable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] C0000-CFFFF write-protect
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] D0000-E7FFF uncachable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] E8000-FFFFF write-protect
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] MTRR variable ranges enabled:
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 0 base 000000000 mask E00000000 write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 1 base 200000000 mask FF0000000 write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 2 base 210000000 mask FF8000000 write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 3 base 218000000 mask FFC000000 write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 4 base 21C000000 mask FFE000000 write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 5 base 21E000000 mask FFF000000 write-back
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 6 base 0E0000000 mask FE0000000 uncachable
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 7 disabled
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 8 disabled
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] 9 disabled
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] total RAM covered: 8176M
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Found optimal setting for mtrr clean up
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] gran_size: 64K chunk_size: 32M num_reg: 6 lose cover RAM: 0G
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] e820: last_pfn = 0xdf800 max_arch_pfn = 0x400000000
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] found SMP MP-table at [mem 0x000fd780-0x000fd78f] mapped at [ (ptrval)]
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Scanning 1 areas for low memory corruption
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] Base memory trampoline at [ (ptrval)] 97000 size 24576
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x18213f000, 0x18213ffff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182140000, 0x182140fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182141000, 0x182141fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182142000, 0x182142fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182143000, 0x182143fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182144000, 0x182144fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182145000, 0x182145fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182146000, 0x182146fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182147000, 0x182147fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182148000, 0x182148fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x182149000, 0x182149fff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] BRK [0x18214a000, 0x18214afff] PGTABLE
Mar 16 02:36:02 kw-desktop kernel: [ 0.000000] RAMDISK: [mem 0x309e6000-0x344eafff]

——————————————————————————崩溃15号日志-崩溃时间(Fri Mar 15 02:39)——————————————————————————:
****************************************auth.log************************************************:
Mar 14 23:25:49 kw-desktop smbd: pam_unix(samba:session): session closed for user nobody
Mar 14 23:53:51 kw-desktop compiz: gkr-pam: unlocked login keyring
Mar 15 00:17:01 kw-desktop CRON[7467]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 15 00:17:01 kw-desktop CRON[7467]: pam_unix(cron:session): session closed for user root
Mar 15 01:17:01 kw-desktop CRON[8211]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 15 01:17:01 kw-desktop CRON[8211]: pam_unix(cron:session): session closed for user root
Mar 15 02:17:01 kw-desktop CRON[8944]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 15 02:17:01 kw-desktop CRON[8944]: pam_unix(cron:session): session closed for user root
Mar 15 02:40:04 kw-desktop systemd-logind[744]: New seat seat0.
Mar 15 02:40:04 kw-desktop systemd-logind[744]: Watching system buttons on /dev/input/event1 (Power Button)
Mar 15 02:40:04 kw-desktop systemd-logind[744]: Watching system buttons on /dev/input/event0 (Power Button)
Mar 15 02:40:09 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet.so): /lib/security/pam_kwallet.so: cannot open shared object file: No such file or directory
Mar 15 02:40:09 kw-desktop lightdm: PAM adding faulty module: pam_kwallet.so
Mar 15 02:40:09 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet5.so): /lib/security/pam_kwallet5.so: cannot open shared object file: No such file or directory
Mar 15 02:40:09 kw-desktop lightdm: PAM adding faulty module: pam_kwallet5.so
Mar 15 02:40:09 kw-desktop lightdm: pam_unix(lightdm-greeter:session): session opened for user lightdm by (uid=0)
Mar 15 02:40:09 kw-desktop systemd-logind[744]: New session c1 of user lightdm.
Mar 15 02:40:09 kw-desktop systemd: pam_unix(systemd-user:session): session opened for user lightdm by (uid=0)
Mar 15 02:40:11 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet.so): /lib/security/pam_kwallet.so: cannot open shared object file: No such file or directory
Mar 15 02:40:11 kw-desktop lightdm: PAM adding faulty module: pam_kwallet.so
Mar 15 02:40:11 kw-desktop lightdm: PAM unable to dlopen(pam_kwallet5.so): /lib/security/pam_kwallet5.so: cannot open shared object file: No such file or directory
Mar 15 02:40:11 kw-desktop lightdm: PAM adding faulty module: pam_kwallet5.so
Mar 15 02:40:11 kw-desktop lightdm: pam_succeed_if(lightdm:auth): requirement "user ingroup nopasswdlogin" not met by user "kw"
Mar 15 02:40:37 kw-desktop dbus[732]: [system] Failed to activate service 'org.bluez': timed out
Mar 15 03:17:01 kw-desktop CRON[1697]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 15 03:17:01 kw-desktop CRON[1697]: pam_unix(cron:session): session closed for user root
Mar 15 04:17:01 kw-desktop CRON[1717]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 15 04:17:01 kw-desktop CRON[1717]: pam_unix(cron:session): session closed for user root
Mar 15 05:17:01 kw-desktop CRON[1733]: pam_unix(cron:session): session opened for user root by (uid=0)

****************************************syslog************************************************:
Mar 14 20:17:01 kw-desktop CRON[4434]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 14 21:17:01 kw-desktop CRON[5204]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 14 22:17:01 kw-desktop CRON[5945]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 14 23:17:01 kw-desktop CRON[6684]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 14 23:53:58 kw-desktop org.gnome.Terminal[1373]: (gnome-terminal-server:3199): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 15 00:17:01 kw-desktop CRON[7468]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 15 01:17:01 kw-desktop CRON[8212]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 15 02:17:01 kw-desktop CRON[8945]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Mar 15 02:40:04 kw-desktop rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="763" x-info="http://www.rsyslog.com"] start
Mar 15 02:40:04 kw-desktop rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Mar 15 02:40:04 kw-desktop rsyslogd: rsyslogd's groupid changed to 108
Mar 15 02:40:04 kw-desktop rsyslogd: rsyslogd's userid changed to 104
Mar 15 02:40:04 kw-desktop systemd-modules-load[254]: Inserted module 'lp'
Mar 15 02:40:04 kw-desktop systemd-modules-load[254]: Inserted module 'ppdev'
Mar 15 02:40:04 kw-desktop systemd-modules-load[254]: Inserted module 'parport_pc'
Mar 15 02:40:04 kw-desktop systemd[1]: Started Create Static Device Nodes in /dev.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting udev Kernel Device Manager...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Apply Kernel Variables.
Mar 15 02:40:04 kw-desktop loadkeys[252]: Loading /etc/console-setup/cached.kmap.gz
Mar 15 02:40:04 kw-desktop systemd[1]: Started Set console keymap.
Mar 15 02:40:04 kw-desktop systemd[1]: Started udev Kernel Device Manager.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Remount Root and Kernel File Systems...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Remount Root and Kernel File Systems.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Flush Journal to Persistent Storage...
Mar 15 02:40:04 kw-desktop systemd[1]: Reached target Local File Systems (Pre).
Mar 15 02:40:04 kw-desktop systemd[1]: Reached target Local File Systems.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Set console font and keymap...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Tell Plymouth To Write Out Runtime Data...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Clean up any mess left by 0dns-up...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting LSB: AppArmor initialization...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting udev Coldplug all Devices...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Load/Save Random Seed...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Load/Save Random Seed.
Mar 15 02:40:04 kw-desktop systemd[1]: Started Flush Journal to Persistent Storage.
Mar 15 02:40:04 kw-desktop systemd[1]: Started Clean up any mess left by 0dns-up.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Nameserver information manager...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Create Volatile Files and Directories...
Mar 15 02:40:04 kw-desktop systemd-tmpfiles[321]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
Mar 15 02:40:04 kw-desktop systemd[1]: Started Nameserver information manager.
Mar 15 02:40:04 kw-desktop systemd[1]: Reached target Network (Pre).
Mar 15 02:40:04 kw-desktop systemd[1]: Started udev Coldplug all Devices.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Show Plymouth Boot Screen...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Braille Device Support.
Mar 15 02:40:04 kw-desktop apparmor[301]: * Starting AppArmor profiles
Mar 15 02:40:04 kw-desktop systemd[1]: Started Tell Plymouth To Write Out Runtime Data.
Mar 15 02:40:04 kw-desktop apparmor[301]: Skipping profile in /etc/apparmor.d/disable: usr.bin.firefox
Mar 15 02:40:04 kw-desktop apparmor[301]: Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd
Mar 15 02:40:04 kw-desktop apparmor[301]: ...done.
Mar 15 02:40:04 kw-desktop systemd[1]: Started LSB: AppArmor initialization.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Raise network interfaces...

****************************************messages.log************************************************:
Mar 14 19:24:38 kw-desktop gnome-session[1515]: (gedit:3148): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 14 19:24:47 kw-desktop gnome-session[1515]: (gedit:3148): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 14 19:24:51 kw-desktop gnome-session[1515]: (nautilus:1720): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 14 19:24:52 kw-desktop gnome-session[1515]: message repeated 3 times: [ (nautilus:1720): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed]
Mar 14 19:24:58 kw-desktop org.gnome.Terminal[1373]: (gnome-terminal-server:3199): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 14 19:36:14 kw-desktop kernel: [ 3351.539621] perf: interrupt took too long (2505 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
Mar 14 19:41:04 kw-desktop org.gnome.evolution.dataserver.Sources5[1373]: ** (evolution-source-registry:1663): WARNING **: secret_service_search_sync: must specify at least one attribute to match
Mar 14 19:45:45 kw-desktop kernel: [ 3922.662781] perf: interrupt took too long (3132 > 3131), lowering kernel.perf_event_max_sample_rate to 63750
Mar 14 19:48:43 kw-desktop org.gnome.Terminal[1373]: (gnome-terminal-server:3199): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 14 20:05:11 kw-desktop kernel: [ 5088.402651] perf: interrupt took too long (3918 > 3915), lowering kernel.perf_event_max_sample_rate to 51000
Mar 14 23:53:58 kw-desktop org.gnome.Terminal[1373]: (gnome-terminal-server:3199): Gdk-CRITICAL **: gdk_device_get_n_axes: assertion 'gdk_device_get_source (device) != GDK_SOURCE_KEYBOARD' failed
Mar 15 02:40:04 kw-desktop rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="763" x-info="http://www.rsyslog.com"] start
Mar 15 02:40:04 kw-desktop rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Mar 15 02:40:04 kw-desktop rsyslogd: rsyslogd's groupid changed to 108
Mar 15 02:40:04 kw-desktop rsyslogd: rsyslogd's userid changed to 104
Mar 15 02:40:04 kw-desktop systemd-modules-load[254]: Inserted module 'lp'
Mar 15 02:40:04 kw-desktop systemd-modules-load[254]: Inserted module 'ppdev'
Mar 15 02:40:04 kw-desktop systemd-modules-load[254]: Inserted module 'parport_pc'
Mar 15 02:40:04 kw-desktop systemd[1]: Started Create Static Device Nodes in /dev.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting udev Kernel Device Manager...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Apply Kernel Variables.
Mar 15 02:40:04 kw-desktop loadkeys[252]: Loading /etc/console-setup/cached.kmap.gz
Mar 15 02:40:04 kw-desktop systemd[1]: Started Set console keymap.
Mar 15 02:40:04 kw-desktop systemd[1]: Started udev Kernel Device Manager.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Remount Root and Kernel File Systems...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Remount Root and Kernel File Systems.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Flush Journal to Persistent Storage...
Mar 15 02:40:04 kw-desktop systemd[1]: Reached target Local File Systems (Pre).
Mar 15 02:40:04 kw-desktop systemd[1]: Reached target Local File Systems.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Set console font and keymap...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Tell Plymouth To Write Out Runtime Data...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Clean up any mess left by 0dns-up...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting LSB: AppArmor initialization...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting udev Coldplug all Devices...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Load/Save Random Seed...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Load/Save Random Seed.
Mar 15 02:40:04 kw-desktop systemd[1]: Started Flush Journal to Persistent Storage.
Mar 15 02:40:04 kw-desktop systemd[1]: Started Clean up any mess left by 0dns-up.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Nameserver information manager...
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Create Volatile Files and Directories...
Mar 15 02:40:04 kw-desktop systemd-tmpfiles[321]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
Mar 15 02:40:04 kw-desktop systemd[1]: Started Nameserver information manager.
Mar 15 02:40:04 kw-desktop systemd[1]: Reached target Network (Pre).
Mar 15 02:40:04 kw-desktop systemd[1]: Started udev Coldplug all Devices.
Mar 15 02:40:04 kw-desktop systemd[1]: Starting Show Plymouth Boot Screen...
Mar 15 02:40:04 kw-desktop systemd[1]: Started Braille Device Support.
Mar 15 02:40:04 kw-desktop apparmor[301]: * Starting AppArmor profiles
Mar 15 02:40:04 kw-desktop systemd[1]: Started Tell Plymouth To Write Out Runtime Data.
Mar 15 02:40:04 kw-desktop apparmor[301]: Skipping profile in /etc/apparmor.d/disable: usr.bin.firefox
Mar 15 02:40:04 kw-desktop apparmor[301]: Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd
Mar 15 02:40:04 kw-desktop apparmor[301]: ...done.
Mar 15 02:40:04 kw-desktop systemd[1]: Started LSB: AppArmor initialization.

****************************************kern.log************************************************:
Mar 14 18:41:27 kw-desktop kernel: [ 64.481319] FAT-fs (sdc1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
Mar 14 19:17:52 kw-desktop kernel: [ 2249.707417] usb 2-1.2: USB disconnect, device number 6
Mar 14 19:36:14 kw-desktop kernel: [ 3351.539621] perf: interrupt took too long (2505 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
Mar 14 19:45:45 kw-desktop kernel: [ 3922.662781] perf: interrupt took too long (3132 > 3131), lowering kernel.perf_event_max_sample_rate to 63750
Mar 14 20:05:11 kw-desktop kernel: [ 5088.402651] perf: interrupt took too long (3918 > 3915), lowering kernel.perf_event_max_sample_rate to 51000
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] microcode: microcode updated early to revision 0x20, date = 2018-04-10
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] Linux version 4.15.0-46-generic (buildd@lgw01-amd64-008) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)) #49~16.04.1-Ubuntu SMP Tue Feb 12 17:45:24 UTC 2019 (Ubuntu 4.15.0-46.49~16.04.1-generic 4.15.18)
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.15.0-46-generic root=UUID=4915f1ea-5f81-4fd0-b2ab-ad094aa2d00c ro quiet splash vt.handoff=7
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] KERNEL supported cpus:
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] Intel GenuineIntel
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] AMD AuthenticAMD
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] Centaur CentaurHauls
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] x86/fpu: Enabled xstate features 0x3, context size is 576 bytes, using 'standard' format.
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] e820: BIOS-provided physical RAM map:
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009d7ff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009d800-0x000000000009ffff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000de214fff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de215000-0x00000000de823fff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de824000-0x00000000de8aefff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de8af000-0x00000000de94bfff] ACPI NVS
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000de94c000-0x00000000deed4fff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000deed5000-0x00000000deed5fff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000deed6000-0x00000000def18fff] ACPI NVS
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000def19000-0x00000000df5c5fff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000df5c6000-0x00000000df7f1fff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000df7f2000-0x00000000df7fffff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed03fff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000021effffff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] NX (Execute Disable) protection: active
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] SMBIOS 2.7 present.
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] DMI: To Be Filled By O.E.M. To Be Filled By O.E.M./H61M-VS4, BIOS P1.40 07/12/2013
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] e820: last_pfn = 0x21f000 max_arch_pfn = 0x400000000
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] MTRR default type: uncachable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] MTRR fixed ranges enabled:
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 00000-9FFFF write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] A0000-BFFFF uncachable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] C0000-CFFFF write-protect
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] D0000-E7FFF uncachable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] E8000-FFFFF write-protect
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] MTRR variable ranges enabled:
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 0 base 000000000 mask E00000000 write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 1 base 200000000 mask FF0000000 write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 2 base 210000000 mask FF8000000 write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 3 base 218000000 mask FFC000000 write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 4 base 21C000000 mask FFE000000 write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 5 base 21E000000 mask FFF000000 write-back
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 6 base 0E0000000 mask FE0000000 uncachable
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 7 disabled
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 8 disabled
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] 9 disabled
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] total RAM covered: 8176M
Mar 15 02:40:04 kw-desktop kernel: [ 0.000000] Found optimal setting for mtrr clean up
q6121223
帖子: 6
注册时间: 2019-03-16 13:41
系统: Ubuntu 16.04 LTS

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#2

帖子 q6121223 » 2019-03-16 14:36

多谢版主批准 and PPS:从wtmp中可以看到16号崩溃时间是16号凌晨02:35;15号是15号凌晨02:39 和我实际程序中专门写的一个记录程序崩溃时间的一个文件的时间节点基本一致。
头像
astolia
论坛版主
帖子: 6445
注册时间: 2008-09-18 13:11

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#3

帖子 astolia » 2019-03-16 16:26

散热做好没有?可能是温度过高导致的,毕竟现在天气也热起来了。
你那边夜间有没有什么供电检修临时停电之类的也可以问问
systemd体系下要用journalctl来看日志
q6121223
帖子: 6
注册时间: 2019-03-16 13:41
系统: Ubuntu 16.04 LTS

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#4

帖子 q6121223 » 2019-03-16 16:56

astolia 写了: 2019-03-16 16:26 散热做好没有?可能是温度过高导致的,毕竟现在天气也热起来了。
你那边夜间有没有什么供电检修临时停电之类的也可以问问
systemd体系下要用journalctl来看日志
多谢您的意见!! 电脑在学校的办公室,连着一个电源出来的插线板,然后有其他电脑接的也是同一个电源接出的不同插线板,这些电脑隔夜都没事,所以如果是电源的问题,应该是插线板的问题,我今晚试试接一下其他没问题的插线板,看看还会不会重启(多问一句,如果真的是电源问题,是不是日志里面无法记载相应的崩溃?就像我这些日志一样,都是崩溃后才出现的日志,崩溃时的错误并没有记录) :Sad
头像
astolia
论坛版主
帖子: 6445
注册时间: 2008-09-18 13:11

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#5

帖子 astolia » 2019-03-16 17:34

外部原因导致的供电中断,日志上基本不可能会有记录的。普通插线板的结构简单,我觉着出这种事的可能性也不大。买个ups来保证供电?
从更恶意的角度揣测,也可能是某个人半夜来动过电源或机器。尤其是如果你运行的东西关系到你或者别人的前途的话,就不可不防了。找保安查查监控,或者自己淘宝上买个微型摄像头来监测一下。
q6121223
帖子: 6
注册时间: 2019-03-16 13:41
系统: Ubuntu 16.04 LTS

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#6

帖子 q6121223 » 2019-03-16 22:01

astolia 写了: 2019-03-16 17:34 外部原因导致的供电中断,日志上基本不可能会有记录的。普通插线板的结构简单,我觉着出这种事的可能性也不大。买个ups来保证供电?
从更恶意的角度揣测,也可能是某个人半夜来动过电源或机器。尤其是如果你运行的东西关系到你或者别人的前途的话,就不可不防了。找保安查查监控,或者自己淘宝上买个微型摄像头来监测一下。
哈哈 应该不会是人为的,晚上走的时候办公室就锁门了,这边人本来也不多,而且这个算法本来也是别人的就是拿来试试随便跑跑,很水的,所以也不存在学术上的竞争。。and我刚才自己主动断电试了下,发现日志的显示和之前崩溃的那些日志规律很相似,所以今晚我试试把电脑接到别的地方或者把别的电脑接到我的这边试试,争取把这个电压因素早日排除,或者这个就是罪魁祸首也说不定 :Stop and多谢大佬相助呀!阿里嘎多!!
q6121223
帖子: 6
注册时间: 2019-03-16 13:41
系统: Ubuntu 16.04 LTS

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#7

帖子 q6121223 » 2019-03-17 19:06

astolia 写了: 2019-03-16 17:34 外部原因导致的供电中断,日志上基本不可能会有记录的。普通插线板的结构简单,我觉着出这种事的可能性也不大。买个ups来保证供电?
从更恶意的角度揣测,也可能是某个人半夜来动过电源或机器。尤其是如果你运行的东西关系到你或者别人的前途的话,就不可不防了。找保安查查监控,或者自己淘宝上买个微型摄像头来监测一下。
大佬,我测试过了,就昨天把这个电脑和别的电脑连同一个插线板,然后刚下午来看,我的电脑还是重启了,别的电脑都没问题,所以应该不是电压问题 :Cry 您觉得如果是内存不足导致的这样重启问题的话,日志里面会有相关记载吗,还是说和直接断电的日志结果一样?还有就是类似电脑崩溃的日志应该在什么地方看,百度的都是说log下的messages里面,可是我这边这个啥也没有,用journalctl 查看崩溃当时的日志 和syslog里面的内容一样 也是从崩溃后1分钟左右才有记录,记录的都是开机所进行的那些启动项之类的操作。。
onlylove
论坛版主
帖子: 5230
注册时间: 2007-01-14 16:23

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#8

帖子 onlylove » 2019-03-17 20:03

你要不要去买个宽幅电源试下,是不是欠压(电压波动)或者老化(质量不好)导致电源输出不足,考虑到你计算量比较大,上个550W的?
q6121223
帖子: 6
注册时间: 2019-03-16 13:41
系统: Ubuntu 16.04 LTS

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#9

帖子 q6121223 » 2019-03-17 23:15

onlylove 写了: 2019-03-17 20:03 你要不要去买个宽幅电源试下,是不是欠压(电压波动)或者老化(质量不好)导致电源输出不足,考虑到你计算量比较大,上个550W的?
我问了下师兄,这台电脑本来就是为了深度学习配的,所以电源当时就买的是比较大功率的,而且奇怪的是,半个月前跑这些深度学习项目都没问题的, 就最近突然开始半夜重启了,所以我感觉硬件方面的原因可能比较小,更多是系统或者算法代码方面的问题 :Sad
onlylove
论坛版主
帖子: 5230
注册时间: 2007-01-14 16:23

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#10

帖子 onlylove » 2019-03-18 2:29

q6121223 写了: 2019-03-17 23:15
onlylove 写了: 2019-03-17 20:03 你要不要去买个宽幅电源试下,是不是欠压(电压波动)或者老化(质量不好)导致电源输出不足,考虑到你计算量比较大,上个550W的?
我问了下师兄,这台电脑本来就是为了深度学习配的,所以电源当时就买的是比较大功率的,而且奇怪的是,半个月前跑这些深度学习项目都没问题的, 就最近突然开始半夜重启了,所以我感觉硬件方面的原因可能比较小,更多是系统或者算法代码方面的问题 :Sad
你要是怀疑系统或者代码的问题,既然你代码用了老代码也不行,肯定不是代码问题,系统你这半个月更新了什么?桌面系统应该有自动更新的吧?如果是软件导致的,日志里面多少得有点痕迹,毫无征兆的重启这种事,你还是看下硬件的比较好,哦,对了,机箱如果散热不好,机器也会保护性关机,你要不要看看是不是散热器?是不是扣具松了硅脂涂厚了什么的,还有,看看电源里面的电容是不是因为高温炸了什么的,散热器什么的,都有自己适用多少TDP的,买小了短时间没问题,时间长了肯定不行,不要觉得硬件买回来装起来就不会出问题了
MXLHELLO
帖子: 1
注册时间: 2019-11-12 19:56
系统: UBUNTU14.04

Re: 求助......16.04显卡深度学习训练到半夜自动重启

#11

帖子 MXLHELLO » 2019-11-12 19:57

q6121223 写了: 2019-03-17 23:15
onlylove 写了: 2019-03-17 20:03 你要不要去买个宽幅电源试下,是不是欠压(电压波动)或者老化(质量不好)导致电源输出不足,考虑到你计算量比较大,上个550W的?
我问了下师兄,这台电脑本来就是为了深度学习配的,所以电源当时就买的是比较大功率的,而且奇怪的是,半个月前跑这些深度学习项目都没问题的, 就最近突然开始半夜重启了,所以我感觉硬件方面的原因可能比较小,更多是系统或者算法代码方面的问题 :Sad
请问你最后解决了吗?我的ubuntu跑模型也经常莫名奇妙重启
回复