Simulator hangs at sim.reset() when running minestudio.simulator.entry

[zeta-zl]

Issue Description:
When running python -m minestudio.simulator.entry for testing, the program hangs at obs, info = sim.reset() and throws the following exception when interrupt:

Traceback (most recent call last):
  File "/home/.../conda/mcvla/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/.../conda/mcvla/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/.../MineStudio/minestudio/simulator/entry.py", line 342, in <module>
    obs, info = sim.reset()
  File "/.../MineStudio/minestudio/simulator/entry.py", line 218, in reset
    self.env.reset()
  File "/.../MineStudio/minestudio/simulator/minerl/env/_singleagent.py", line 22, in reset
    multi_obs = super().reset()
  File "/.../MineStudio/minestudio/simulator/minerl/env/_multiagent.py", line 478, in reset
    self._setup_instances()
  File "/.../MineStudio/minestudio/simulator/minerl/env/_multiagent.py", line 579, in _setup_instances
    with ThreadPoolExecutor(max_workers=num_instances_to_start) as tpe:
  File "/home/.../conda/mcvla/lib/python3.10/concurrent/futures/_base.py", line 649, in __exit__
    self.shutdown(wait=True)
  File "/home/.../conda/mcvla/lib/python3.10/concurrent/futures/thread.py", line 235, in shutdown
    t.join()
  File "/home/.../conda/mcvla/lib/python3.10/threading.py", line 1096, in join
    self._wait_for_tstate_lock()
  File "/home/.../conda/mcvla/lib/python3.10/threading.py", line 1116, in _wait_for_tstate_lock
    if lock.acquire(block, timeout):
KeyboardInterrupt

Environment:

• OS: CentOS 7
• Python: 3.10.14
• Java path: /usr/local/jdk1.8.0_45/bin/java (installed via yum)

Steps Taken:

1. Referenced Issue #12 to confirm Java installation method. Confirmed that Java was not installed via conda. But I have to install it via yum since i'm using CentOS.
2. Directly ran the command from _launch_minecraft in MineStudio/minestudio/simulator/minerl/env/malmo.py:

   MineStudio/minestudio/simulator/minerl/env/launchClient.sh -port 12537 -fatjar /tmp/MineStudio/engine/build/libs/mcprec-6.13.jar -device cpu

   The output logs are as follows:

   SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
   SLF4J: Defaulting to no-operation (NOP) logger implementation
   SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
   [14:33:40] [main/INFO]: [OptiFine] (Reflector) Field not found: World.tileEntitiesToBeRemoved
   [14:33:40] [main/INFO]: [OptiFine] (Reflector) Class not present: net.minecraftforge.eventbus.api.Event$Result
   [14:33:40] [main/INFO]: [OptiFine] (Reflector) Method not present: net.minecraftforge.common.extensions.IForgeBlockState.hasTileEntity
   [14:33:40] [main/INFO]: [OptiFine] (Reflector) Class not present: net.minecraftforge.common.extensions.IForgeEntity
   [14:33:40] [main/INFO]: [OptiFine] (Reflector) Class not present: net.minecraftforge.fml.CrashReportExtender
   [14:33:41] [main/INFO]: [OptiFine] (Reflector) Method not present: net.minecraft.tags.ItemTags.createOptional
   [14:33:46] [Render thread/INFO]: [OptiFine] (Reflector) Class not present: net.minecraftforge.client.ForgeHooksClient
   [14:33:46] [Render thread/INFO]: Environment: authHost='https://authserver.mojang.com', accountsHost='https://api.mojang.com', sessionHost='https://sessionserver.mojang.com', servicesHost='https://api.minecraftservices.com', name='PROD'
   [14:33:48] [Render thread/ERROR]: Failed to verify authentication!
   [14:33:48] [Render thread/INFO]: Setting user: Player307
   [14:33:48] [Render thread/INFO]: [OptiFine] (Reflector) Class not present: net.minecraftforge.client.settings.KeyConflictContext
   [14:33:48] [Render thread/INFO]: [OptiFine] (Reflector) Class not present: net.minecraft.launchwrapper.Launch
   [14:33:48] [Render thread/INFO]: Backend library: LWJGL version 3.2.2 SNAPSHOT
   

   After this, the Minecraft client produces no further output, and the simulator hangs.

I would greatly appreciate any advice or suggestions to resolve this issue.

[muzhancun]

Could you check java version and whether xvfb is installed? By the way I use openjdk with conda installation on Rocky Linux (maybe similar to CentOS), so you can still try conda installation.

[zeta-zl]

My Java version is as follows:

$ java -version
java version "1.8.0_45"
Java(TM) SE Runtime Environment (build 1.8.0_45-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)

I have installed Xvfb, and its version information is:

$ sudo yum info xorg-x11-server-Xvfb
Installed Packages
Name        : xorg-x11-server-Xvfb
Arch        : x86_64
Version     : 1.20.4
Release     : 27.el7_9
Size        : 1.9 M
Repo        : installed
From repo   : updates
Summary     : A X Windows System virtual framebuffer X server.
URL         : http://www.x.org
License     : MIT and GPLv2
Description : Xvfb (X Virtual Frame Buffer) is an X server that is able to run on
            : machines with no display hardware and no physical input devices.
            : Xvfb simulates a dumb framebuffer using virtual memory.  Xvfb does
            : not open any devices, but behaves otherwise as an X display.  Xvfb
            : is normally used for testing servers.

I have also tried installing via conda, but unfortunately, it did not make any difference.

Additionally, I attempted to enable debug level logging in log4j, and I obtained the following output:

[15:10:35] [Render thread/DEBUG]: Opening connection to https://api.minecraftservices.com/privileges
[15:10:36] [Render thread/DEBUG]: Reading data from https://api.minecraftservices.com/privileges
[15:10:38] [Render thread/DEBUG]: Reading error page from https://api.minecraftservices.com/privileges
[15:10:38] [Render thread/DEBUG]: Successful read, server response was 401
[15:10:38] [Render thread/DEBUG]: Response: {
  "path" : "/privileges"
}
[15:10:38] [Render thread/INFO]: Setting user: Player463
[15:10:38] [Render thread/DEBUG]: (Session ID is token:null:6256f6e3-2e58-3651-998e-2564a0b2a631)
[15:10:38] [Render thread/INFO]: [OptiFine] (Reflector) Class not present: net.minecraftforge.client.settings.KeyConflictContext
[15:10:38] [Render thread/INFO]: [OptiFine] (Reflector) Class not present: net.minecraft.launchwrapper.Launch
[15:10:38] [Render thread/INFO]: Backend library: LWJGL version 3.2.2 SNAPSHOT
[15:11:01] [Worker-Bootstrap-3/DEBUG]: Worker-Bootstrap-3 shutdown
[15:11:05] [Worker-Bootstrap-2/DEBUG]: Worker-Bootstrap-2 shutdown
[15:11:11] [Worker-Bootstrap-1/DEBUG]: Worker-Bootstrap-1 shutdown

I would like to know whether this could be related to the issue I am experiencing, and if there are any possible solutions you could suggest.

Thank you very much for your assistance.