I have installed vncserver on my RHEL6 before, and possibly left some services running. I then re-installed it, but had trouble starting the service. There were apparently some views already running, but it created a view :6 and I was able to connect to my RHEL machine from Windows7.
To fix my above problem I stopped the vncserver service, went to my /tmp/.X11-unit/ directory and deleted all files from there (X0-X6)
I now try to start vncserver but I get the error below. I can successfully start it with parameters "-nolisten tcp -localhost", but when I try to connect from Windows7 with my VNC client then it just gives a black screen.
"WARNING: The first attempt to start Xvnc failed, possibly because the font catalog is not properly configured. Attempting to determine an appropriate font path for this system and restart Xvnc using that font path ... Could not start Xvnc.
_XSERVTransSocketUNIXCreateListener: ...SocketCreateListener() failed _XSERVTransMakeAllCOTSServerListeners: server already running Warning: Xalloc: requesting unpleasantly large amount of memory: 0 bytes.
Fatal server error: Cannot establish any listening sockets - Make sure an X server isn't already running _XSERVTransSocketUNIXCreateListener: ...SocketCreateListener() failed _XSERVTransMakeAllCOTSServerListeners: server already running Warning: Xalloc: requesting unpleasantly large amount of memory: 0 bytes.
Fatal server error: Cannot establish any listening sockets - Make sure an X server isn't already running"
Any ideas on how to fix this? :) I already re-installed vncserver again, and used "ps -ef | grep vnc" to check that no other vnc services were running.
I had got similar problem in CentOS 6.4. As the warning said, the real problem is that the Xvnc was not started. Xvnc relys on several other services to support the Xwindow(such as the xfs font service).I put lots of effort on finding what was missing but came back empty-handed.
So what I did was doing a full "yum update" (in Centos), and the problem was solved.
If you want to dig further, I suggest focus on the Xorg part.