Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error processing dataset #1618

Open
aeciolemos opened this issue Feb 26, 2025 · 2 comments
Open

Error processing dataset #1618

aeciolemos opened this issue Feb 26, 2025 · 2 comments

Comments

@aeciolemos
Copy link

How did you install WebODM (docker, installer, etc.)?
INSTALLER 2.7.0

What's your browser and operating system? (Copy/paste the output of https://www.whatismybrowser.com/)
Chrome 132 on Windows 11
i7 8th gen with 32GB RAM and a 1TB SSD

What is the problem?
I have been trying to process a task with 1750 photos and it has been failing.
I see these errors in the log and it says to report, but I am not sure they are relevant to the error

"python: ERROR Uncaught error! This is potentially bad. Please report it to http://github.com/OpenDroneMap/WebODM/issues: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\WebODM\resources\app\data\media\project/2/task/e9a30f95-2665-43d1-b700-8112e3787b0c/assets\odm_orthophoto\odm_orthophoto.tif' Traceback (most recent call last):\r\n File "C:\WebODM\resources\app\apps\WebODM\worker\tasks.py", line 143, in process_task\r\n task.process()\r\n File "C:\WebODM\resources\app\apps\WebODM\app\models\task.py", line 797, in process\r\n self.delete()\r\n File "C:\WebODM\resources\app\apps\WebODM\app\models\task.py", line 1128, in delete\r\n shutil.rmtree(directory_to_delete)\r\n File "C:\WebODM\resources\app\apps\grass78\Python39\lib\shutil.py", line 740, in rmtree\r\n return _rmtree_unsafe(path, onerror)\r\n File "C:\WebODM\resources\app\apps\grass78\Python39\lib\shutil.py", line 613, in _rmtree_unsafe\r\n _rmtree_unsafe(fullname, onerror)\r\n File "C:\WebODM\resources\app\apps\grass78\Python39\lib\shutil.py", line 613, in _rmtree_unsafe\r\n _rmtree_unsafe(fullname, onerror)\r\n File "C:\WebODM\resources\app\apps\grass78\Python39\lib\shutil.py", line 618, in _rmtree_unsafe\r\n onerror(os.unlink, fullname, sys.exc_info())\r\n File "C:\WebODM\resources\app\apps\grass78\Python39\lib\shutil.py", line 616, in _rmtree_unsafe\r\n os.unlink(fullname)\r\nPermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\WebODM\resources\app\data\media\project/2/task/e9a30f95-2665-43d1-b700-8112e3787b0c/assets\odm_orthophoto\odm_orthophoto.tif'\r\n\r\n"

How can we reproduce this? (What steps trigger the problem? What parameters are you using for processing? Include screenshots. If you are having issues processing a dataset, you must include a copy of your dataset uploaded on Dropbox, Google Drive or https://dronedb.app/)
I set up a Fast Orthophoto task with 1750 photos. I set it to run. It runs for about 6.5h then fails. I don't know where to look for errors, I have attached the app log. I am running the same task again now.

app.log
pgsql.log

Image

@aeciolemos
Copy link
Author

aeciolemos commented Feb 26, 2025

One more clue, it is stuck on Calculating face qualities 72%. It has been at that point for about 1h now.

I can provide copy of the images, however, it is 1750 12MP images, so it will be a huge dataset to copy to GDrive or Dropbox or something and it is client information, so I would probably need a property release form from them.

Image

LASTLY, WebODM does NOT survive SLEEP or HIBERNATE on Windows 11. If the computer sleeps or goes into hibernation, the processing freezes up. Even cancelling takes a long time and might be frozen as well.

@aeciolemos
Copy link
Author

Ok, I figured out the issue. I activated the console output and it says I ran out of memory.

[ERROR] Whoops! You ran out of memory! Add more RAM to your computer, if you're using docker configure it to use more memory, for WSL2 make use of .wslconfig (https://docs.microsoft.com/en-us/windows/wsl/wsl-config#configure-global-options-with-wslconfig), resize your images, lower the quality settings or process the images using a cloud provider (e.g. https://webodm.net).

I changed my paging file on my C: drive to System Managed and I will run it again to see if that solves it. However, the other issue reported above seems to be separate from this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant