Virtualmin Webmin keeps failing - stops with error Centos 7 - no restart

Webmin
1

I have an new server with Centos 7. Migrated sites from an older Centos 6 server. All is working except Webmin keeps stopping. When it is stopped YUM is also not working. (If I reboot it comes up but stops after a few minutes.) If I restart webmin I get this error:
# /etc/init.d/webmin status
Webmin is stopped

/etc/init.d/webmin start

/etc/init.d/webmin: line 28: 13198 Segmentation fault $START > /dev/null 2>&1 < /dev/null

If I run dmesg
# dmesg | tail -30
[19993578.972678] VE265134: no allowed mount options found for device 182:183713

Not sure what this means. Somethings not mounted?

]# /etc/init.d/webmin start
/etc/init.d/webmin: line 28: 15111 Segmentation fault $START > /dev/null 2>&1 < /dev/null

/etc/webmin/start

Starting Webmin server in /usr/libexec/webmin
Segmentation fault

If I try a Yum update
#yum update
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Traceback (most recent call last):
File “/bin/yum”, line 29, in
yummain.user_main(sys.argv[1:], exit_code=True)
File “/usr/share/yum-cli/yummain.py”, line 375, in user_main
errcode = main(args)
File “/usr/share/yum-cli/yummain.py”, line 184, in main
result, resultmsgs = base.doCommands()
File “/usr/share/yum-cli/cli.py”, line 585, in doCommands
return self.yum_cli_commands[self.basecmd].doCommand(self, self.basecmd, self.extcmds)
File “/usr/share/yum-cli/yumcommands.py”, line 505, in doCommand
ret = base.updatePkgs(extcmds, update_to=(basecmd == ‘update-to’))
File “/usr/share/yum-cli/cli.py”, line 1069, in updatePkgs
self.update()
File “/usr/lib/python2.7/site-packages/yum/init.py”, line 5152, in update
updates = self.up.getUpdatesTuples()
File “/usr/lib/python2.7/site-packages/yum/init.py”, line 1094, in
up = property(fget=lambda self: self._getUpdates(),
File “/usr/lib/python2.7/site-packages/yum/init.py”, line 838, in _getUpdates
self._up = rpmUtils.updates.Updates(self.rpmdb.simplePkgList(), self.pkgSack.simplePkgList())
File “/usr/lib/python2.7/site-packages/yum/init.py”, line 1075, in
pkgSack = property(fget=lambda self: self._getSacks(),
File “/usr/lib/python2.7/site-packages/yum/init.py”, line 778, in _getSacks
self.repos.populateSack(which=repos)
File “/usr/lib/python2.7/site-packages/yum/repos.py”, line 347, in populateSack
self.doSetup()
File “/usr/lib/python2.7/site-packages/yum/repos.py”, line 122, in doSetup
self.ayum.plugins.run(‘prereposetup’)
File “/usr/lib/python2.7/site-packages/yum/plugins.py”, line 188, in run
func(conduitcls(self, self.base, conf, **kwargs))
File “/usr/lib/yum-plugins/fastestmirror.py”, line 202, in prereposetup_hook
all_urls = FastestMirror(all_urls).get_mirrorlist()
File “/usr/lib/yum-plugins/fastestmirror.py”, line 369, in get_mirrorlist
self._poll_mirrors()
File “/usr/lib/yum-plugins/fastestmirror.py”, line 413, in _poll_mirrors
pollThread.start()
File “/usr/lib64/python2.7/threading.py”, line 747, in start
_start_new_thread(self.__bootstrap, ())
thread.error: can’t start new thread

2

I got rid of the Segmentation message but Webmin still won’t start. I run ps auxw | grep miniserv | grep webmin and nothing is running. I run
# /etc/init.d/webmin start
[~]# /etc/init.d/webmin status
Webmin is stopped

Nothing. The server is running and httpd is good. Did I mention the this is a Centos 7 on an OpenVZ server.

3

Strange log settings:
# tail /var/webmin/webmin.debug
tail: cannot open ‘/var/webmin/webmin.debug’ for reading: No such file or directory
[ ~]# tail /var/webmin/miniserv.error
[27/Jun/2019:10:06:12 -0400] Using SHA512 module Crypt::SHA
[27/Jun/2019:10:06:12 -0400] Perl module Authen::PAM needed for PAM is not installed : Can’t locate Authen/PAM.pm in @INC (@INC contains: /usr/libexec/webmin /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at (eval 14) line 1.
BEGIN failed–compilation aborted at (eval 14) line 1.

[27/Jun/2019:12:22:12 -0400] miniserv.pl started
[27/Jun/2019:12:22:12 -0400] Using MD5 module Digest::MD5
[27/Jun/2019:12:22:12 -0400] Using SHA512 module Crypt::SHA
[27/Jun/2019:12:22:12 -0400] Perl module Authen::PAM needed for PAM is not installed : Can’t locate Authen/PAM.pm in @INC (@INC contains: /usr/libexec/webmin /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at (eval 14) line 1.
BEGIN failed–compilation aborted at (eval 14) line 1.

This is in the webmin logs
# tail /var/webmin/webmin.log
1561630803.1732.0 [27/Jun/2019 06:20:03] - - - webmincron webmincron.pl “run” “webmincron” “15612450796253” active=‘1’ arg0=‘collectinfo.pl’ days=’’ func=‘run_cron_script’ hours=’’ id=‘15612450796253’ mins=‘0,5,10,15,20,25,30,35,40,45,50,55’ module=‘virtual-server’ months=’’ user=‘root’ weekdays=’’
1561630873.1769.0 [27/Jun/2019 06:21:13] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561631103.1884.0 [27/Jun/2019 06:25:03] - - - webmincron webmincron.pl “run” “webmincron” “15612450796253” active=‘1’ arg0=‘collectinfo.pl’ days=’’ func=‘run_cron_script’ hours=’’ id=‘15612450796253’ mins=‘0,5,10,15,20,25,30,35,40,45,50,55’ module=‘virtual-server’ months=’’ user=‘root’ weekdays=’’
1561634479.3806.0 [27/Jun/2019 07:21:19] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561644046.10041.0 [27/Jun/2019 10:00:46] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561644054.10054.0 [27/Jun/2019 10:00:54] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561644104.10126.0 [27/Jun/2019 10:01:44] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561644118.10137.0 [27/Jun/2019 10:01:58] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561644372.10303.0 [27/Jun/2019 10:06:12] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’
1561652532.16000.0 [27/Jun/2019 12:22:12] - - - webmincron webmincron.pl “run” “webmincron” “15612450745801” func=‘cleanup_temp_files’ id=‘15612450745801’ interval=‘3600’ module=‘cron’

4

I take it back - segmentation error is back. Unable to get Webmin to start. It is dead as a rock.
# /etc/init.d/webmin start
/etc/init.d/webmin: line 28: 17222 Segmentation fault $START > /dev/null 2>&1 < /dev/null

5

Howdy,

Segmentation faults like that are usually a sign of something very wrong on the system… some sort of hardware issue, corrupt files, or in the case of a VPS, it could happen due to some sort of resource restriction that’s been exceeded… we’ve seen that with OpenVZ from time to time.

They can be tricky to diagnose, but I might start by verifying that if you’re using a VPS, you aren’t exceeding the available resources. And then from there, validate the files on the filesystem to ensure nothing is corrupted. If it’s a dedicated server, maybe check the RAM, and run some sort of hard drive scan as well.

-Eric