Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Video / Image task fails #340

Open
bardram opened this issue Oct 23, 2024 · 5 comments
Open

Video / Image task fails #340

bardram opened this issue Oct 23, 2024 · 5 comments
Labels
bug Something isn't working

Comments

@bardram
Copy link
Contributor

bardram commented Oct 23, 2024 •
edited
Loading

When using the image task it fails with an assertion error when clicking on the "green" save button.

image

The picture is taken but not uploaded to the database / saved in any way.

Testing on the Samsung S10e Android 12 / SDK 33 phone.

The log is:

D/InsetsSourceConsumer(26202): ensureControlAlpha: for ITYPE_STATUS_BAR on dk.cachet.carp_study_app/dk.carp.studies_app.MainActivity
I/ViewRootImpl@4526430[MainActivity](26202): ViewPostIme pointer 0
I/ViewRootImpl@4526430[MainActivity](26202): ViewPostIme pointer 1
D/ImageCapture(26202): takePictureInternal
D/CameraOrientationUtil(26202): getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=90, isOppositeFacing=true, result=90
D/TakePictureManager(26202): Issue the next TakePictureRequest.
D/Camera2CameraImpl(26202): {Camera@660f297[id=0]} Issue capture request
D/CaptureSession(26202): Issuing capture request.
D/Camera2CaptureRequestBuilder(26202): createCaptureRequest
W/AndroidMediaUtils(26202): Image_getBlobSize: No JPEG/HEIC header detected, defaulting to size=width=18289152
D/TakePictureManager(26202): Issue the next TakePictureRequest.
D/TakePictureManager(26202): No new request.
I/BpBinder(26202): onLastStrongRef automatically unlinking death recipients: <uncached descriptor>
[log] [CAMS INFO] Starting BackgroundTaskExecutor [511368468] (initialized)
[log] [CAMS INFO] Starting VideoProbe [490871400] (initialized)
[log] [CAMS DEBUG] VideoProbe - Checking permission for: [Permission.camera]
[log] [CAMS DEBUG] VideoUserTask - onPictureCapture(), media: /data/user/0/dk.cachet.carp_study_app/cache/CAP8480050397187952853.jpg
I/ExoPlayerImpl(26202): Init 709836 [AndroidXMedia3/1.4.1] [beyond0, SM-G970F, samsung, 31]
I/ViewRootImpl@4526430[MainActivity](26202): ViewPostIme pointer 0
I/ViewRootImpl@4526430[MainActivity](26202): ViewPostIme pointer 1
[log] [CAMS INFO] Stopping VideoProbe [490871400] (started)
[log] [CAMS DEBUG] VideoProbe [490871400] (stopped) - stopped
[log] [CAMS DEBUG] BackgroundTaskExecutor - all probes have stopped - stopping this BackgroundTaskExecutor too.
[log] [CAMS INFO] Stopping BackgroundTaskExecutor [511368468] (started)
[log] [CAMS INFO] Stopping VideoProbe [490871400] (stopped)
[log] [CAMS WARNING] Trying to stop a VideoProbe in a state where this cannot be done - state: 'stopped'. Ignoring this.
[log] [CAMS DEBUG] BackgroundTaskExecutor [511368468] (stopped) - stopped
I/flutter (26202): {
I/flutter (26202):  "sensorStartTime": 1729712839573329,
I/flutter (26202):  "data": {
I/flutter (26202):   "__type": "dk.cachet.carp.batterystate",
I/flutter (26202):   "batteryLevel": 37,
I/flutter (26202):   "batteryStatus": "charging"
I/flutter (26202):  }
I/flutter (26202): }
I/ViewRootImpl@4526430[MainActivity](26202): ViewPostIme pointer 0
[log] [CAMS DEBUG] SQLiteDataManager - wrote measurement to SQLite - id: 125, type: dk.cachet.carp.batterystate, device role name: Primary Phone.
I/ViewRootImpl@4526430[MainActivity](26202): ViewPostIme pointer 1
[log] [CAMS DEBUG] VideoUserTask - onSave(), file: /data/user/0/dk.cachet.carp_study_app/cache/CAP8480050397187952853.jpg
[log] [CAMS INFO] Stopping BackgroundTaskExecutor [511368468] (stopped)
[log] [CAMS WARNING] Trying to stop a BackgroundTaskExecutor in a state where this cannot be done - state: 'stopped'. Ignoring this.
[log] [CAMS INFO] AppTaskController - Marked VideoUserTask - id: f376d902-7739-4958-81bf-4b82bcd2fb0d, type: image, title: Wound Healing, state: UserTaskState.done, triggerTime: 2024-10-23 21:45:00.919767 as done

and

E/flutter (26202): [ERROR:flutter/runtime/dart_vm_initializer.cc(41)] Unhandled Exception: 'package:flutter/src/widgets/navigator.dart': Failed assertion: line 4894 pos 12: '!_debugLocked': is not true.
E/flutter (26202): #0      _AssertionError._doThrowNew (dart:core-patch/errors_patch.dart:50:61)
E/flutter (26202): #1      _AssertionError._throwNew (dart:core-patch/errors_patch.dart:40:5)
E/flutter (26202): #2      NavigatorState._pushEntry (package:flutter/src/widgets/navigator.dart:4894:12)
E/flutter (26202): #3      NavigatorState.push (package:flutter/src/widgets/navigator.dart:4851:5)
E/flutter (26202): #4      showDialog (package:flutter/src/material/dialog.dart:1431:65)
E/flutter (26202): #5      CameraTaskPageState._showCancelConfirmationDialog (package:carp_study_app/ui/pages/camera_task_page.dart:128:12)
E/flutter (26202): #6      CameraTaskPageState.build.<anonymous closure> (package:carp_study_app/ui/pages/camera_task_page.dart:20:13)
E/flutter (26202): #7      PopScope._callPopInvoked (package:flutter/src/widgets/pop_scope.dart:140:19)
E/flutter (26202): #8      _PopScopeState.onPopInvokedWithResult (package:flutter/src/widgets/pop_scope.dart:172:12)
E/flutter (26202): #9      ModalRoute.onPopInvokedWithResult (package:flutter/src/widgets/routes.dart:1780:16)
E/flutter (26202): #10     NavigatorState.pop (package:flutter/src/widgets/navigator.dart:5362:19)
E/flutter (26202): #11     DisplayPicturePageState.build.<anonymous closure> (package:carp_study_app/ui/pages/display_picture_page.dart:119:59)
E/flutter (26202): #12     _InkResponseState.handleTap (package:flutter/src/material/ink_well.dart:1170:21)
E/flutter (26202): #13     GestureRecognizer.invokeCallback (package:flutter/src/gestures/recognizer.dart:351:24)
E/flutter (26202): #14     TapGestureRecognizer.handleTapUp (package:flutter/src/gestures/tap.dart:656:11)
E/flutter (26202): #15     BaseTapGestureRecognizer._checkUp (package:flutter/src/gestures/tap.dart:313:5)
E/flutter (26202): #16     BaseTapGestureRecognizer.acceptGesture (package:flutter/src/gestures/tap.dart:283:7)
E/flutter (26202): #17     GestureArenaManager.sweep (package:flutter/src/gestures/arena.dart:169:27)
E/flutter (26202): #18     GestureBinding.handleEvent (package:flutter/src/gestures/binding.dart:505:20)
E/flutter (26202): #19     GestureBinding.dispatchEvent (package:flutter/src/gestures/binding.dart:481:22)
E/flutter (26202): #20     RendererBinding.dispatchEvent (package:flutter/src/rendering/binding.dart:450:11)
E/flutter (26202): #21     GestureBinding._handlePointerEventImmediately (package:flutter/src/gestures/binding.dart:426:7)
E/flutter (26202): #22     GestureBinding.handlePointerEvent (package:flutter/src/gestures/binding.dart:389:5)
E/flutter (26202): #23     GestureBinding._flushPointerEventQueue (package:flutter/src/gestures/binding.dart:336:7)
E/flutter (26202): #24     GestureBinding._handlePointerDataPacket (package:flutter/src/gestures/binding.dart:305:9)
E/flutter (26202): #25     _invoke1 (dart:ui/hooks.dart:328:13)
E/flutter (26202): #26     PlatformDispatcher._dispatchPointerDataPacket (dart:ui/platform_dispatcher.dart:442:7)
E/flutter (26202): #27     _dispatchPointerDataPacket (dart:ui/hooks.dart:262:31)
@bardram bardram added the bug Something isn't working label Oct 23, 2024
@bardram
Copy link
Contributor Author

bardram commented Oct 24, 2024 •
edited
Loading

There is no media file in CAWS when I download the data.

This can be caused by several things:

  1. Data is not uploaded @bardram
  2. Data is not stored @yuanchen233
  3. Data is not extracted in the export file @yuanchen233

@bardram
Copy link
Contributor Author

bardram commented Oct 29, 2024

The video task now works with the UI w/o the exception above.

However, the media is still not uploaded to CAWS. Here is the log:

[log] [CAMS DEBUG] DataStreamBuffer - getting data stream batch for device 'Primary Phone' and data type 'dk.cachet.carp.audio'.
[log] [CAMS DEBUG] DataStreamBuffer - getting data stream batch for device 'Primary Phone' and data type 'dk.cachet.carp.image'.

But neither the json or the files are in the download from CAWS.

@bardram
Copy link
Contributor Author

bardram commented Oct 29, 2024

Now the JSON and files are uploaded to CAWS. But when downloading, the filenames of the downloaded files does not match the names of the files uploaded.

Here are two audio recordings:

      "measurements": [
        {
          "data": {
            "id": "f2307b9b-e401-4014-b2c7-68e05e2ca17c",
            "__type": "dk.cachet.carp.audio",
            "upload": true,
            "filename": "f2307b9b-e401-4014-b2c7-68e05e2ca17c.mp4",
            "metadata": {},
            "mediaType": "audio",
            "endRecordingTime": "2024-10-29T19:30:46.677579Z",
            "startRecordingTime": "2024-10-29T19:30:34.778037Z"
          },
          "sensorEndTime": 1730230246677579,
          "sensorStartTime": 1730230234778037
        },
        {
          "data": {
            "id": "f2307b9b-e401-4014-b2c7-68e05e2ca17c",
            "__type": "dk.cachet.carp.audio",
            "upload": true,
            "filename": "f2307b9b-e401-4014-b2c7-68e05e2ca17c.mp4",
            "metadata": {},
            "mediaType": "audio",
            "endRecordingTime": "2024-10-29T19:30:46.677579Z",
            "startRecordingTime": "2024-10-29T19:30:34.778037Z"
          },
          "sensorEndTime": 1730230246677579,
          "sensorStartTime": 1730230234778037
        }
      ]

But the files downloaded with it looks like this

image

@bardram
Copy link
Contributor Author

bardram commented Oct 29, 2024 •
edited
Loading

The file upload task seems to work fine with audio files but not image files - here is the log, where only one file upload tasks ends....?

[log] [CAMS INFO] CarpDataManager - File attachment upload to CAWS started - path : '/data/user/0/dk.cachet.carp_study_app/app_flutter/carp/deployments/b8b4bf38-5026-417f-bd2f-218fa704b4f7/data/media/073f1797-7ba0-48d7-9e9f-c9fe98250126.mp4'
[log] [CAMS INFO] CarpDataManager - File attachment upload to CAWS started - path : '/data/user/0/dk.cachet.carp_study_app/cache/CAP4387157332099287494.jpg'
[log] [CAMS DEBUG] DataStreamBuffer - cleaned up. N=11 records deleted.
[log] [CAMS INFO] CarpDataManager - File upload to CAWS finished - server id : 60

Subsequently getting TimeoutException on the upload task:

I/flutter (13522): TimeoutException - Retrying to SEND https://dev.carp.dk/api/studies/d4ed449f-eb15-443e-b768-416e50d92a80/files

@bardram
Copy link
Contributor Author

bardram commented Oct 30, 2024

Sometimes it return an HTTP error 413:

[log] [CAMS WARNING] CarpDataManager - Error uploading file attachment - 413 null

which is defined as;

A 413 HTTP error code occurs when the size of a client's request exceeds the server's file size limit. This typically happens when a client attempts to upload a large file to a web server, and the server responds with a 413 error to alert the client.

bardram added a commit to cph-cachet/carp.sensing-flutter that referenced this issue Oct 31, 2024
@bardram
Improvement to file upload
e0003db 
* fix of cph-cachet/carp_studies_app#340
* fix of cph-cachet/carp_studies_app#341
* handling error messages from NGINX
* improved unit testing in carp_backend
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@bardram