[Support]: How is an "event" video clip constructed ? Full, no-doubt lengthy details requested please! #12762

ElectronicBattle · 2024-08-04T20:26:19Z

ElectronicBattle
Aug 4, 2024

Describe the problem you are having

Hello all

I am still unable to play the event video clips in either of my two linux boxes, using any browser, and I don't know why.

I still get this message:

The media playback was aborted due to a corruption problem or because the media used features your browser did not support

However, that same browser (Chromium, and also Chrome) can play from a variety of test pages when I point it at hls or h265 or m3u8 links. e.g.

https://ottverse.com/free-hls-m3u8-test-urls/
https://test-streams.mux.dev/

Also note that my LG television, my android tablets and my phones can play the event video clips in-browser.

Thus there seems to be nothing wrong with the stream generated by Frigate, nor does there seem to be anything wrong with these two linux boxes (they're effectively clients for the Frigate UI which is itself served out of a separate box on my LAN).

I have extracted the m3u8 from Frigate's webUI and it plays in VLC and ffplay on both of my linux boxes which the webUI serves out to.

I don't think this is anything to do with transcoding so I would like to find out all of the details as to how the hevc hls stream is constructed inside Frigate. I am convinced I should be able to play from (inside) the webUI without laboriously having to manually extract the m3u8 for each clip. I have all of the libgstreamer libs installed which is why I can play using VLC & co. the streams from the m3u8s within Frigate's webUI.

I know I have asked these sorts of questions before and had some answers (thanks @hawkeye217 and @NickM-27) , but it is taking me a long time to build up an accurate picture of this fairly involved situation.

Please can someone point me in the right direction so I can find out the exact codecs used, how the stream is constructed and delivered? I might be able to overcome this frustrating hurdle if it turns out there is a very specific configuration needed in my pair of linux client OS/browsers.

Version

0.13.2-6476F8A

Frigate config file

#config_310724_NO_RESTREAMING_FIXED taken from #config_and_audio_110724# # this works with the FrigateViewer tablet app - events playback OK
# improved detection (height & width added) # also added ffmpeg out args record audio and logger entries at EOF

ui:
  use_experimental: false
  live_mode: mse

mqtt:
  enabled: false


go2rtc:
  streams:
    
    #reference format from NickM-27 @ https://github.com/blakeblackshear/frigate/discussions/12376 
    #              "ffmpeg:rtsp://...                                               #video=h264#audio=copy#hardware" note the quotes and hashes
    greenhouse:    
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=0&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:greenhouse#audio=opus"
    upper_patio:   
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=1&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:upper_patio#audio=opus"
    ponds:         
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=2&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:ponds#audio=opus"
    blue_gate:     
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=3&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:blue_gate#audio=opus"
    lower_steps:   
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=4&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:lower_steps#audio=opus"
    lower_patio:   
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=5&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:lower_patio#audio=opus"
    shed:          
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=6&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:shed#audio=opus"
    drive:         
      - "ffmpeg:rtsp://192.168.1.123:554/media=0/channel=7&level=0/track0#video=h264#audio=copy#hardware"
      - "ffmpeg:drive#audio=opus"
    

####rtsp is 30060 and webRTC is 30061 (TN Frigate app interrnals)
  webrtc:
    candidates:
    - 192.168.1.194:30061
    - stun:30061


ffmpeg:
  #####you can only have one line here#####
  hwaccel_args: preset-nvidia-h264
  #hwaccel_args: preset-nvidia-hevc #gives black screens on cameras
  #hwaccel_args: preset-nvidia-cuvid #gives black screens on cameras
  output_args:
    record: preset-record-generic-audio-aac
  
detectors:
  coral:
    type: edgetpu
    device: usb
    detect:
      enabled: true

birdseye:
  enabled: true
  mode: continuous #continuous | objects | motion

# record: # <----- Enable recording # was working
#  enabled: true # was working

# added from https://fixtse.com/blog/coral-ia-frigate start#
record:
  enabled: true
  retain:
    days: 7
    mode: motion
  events:
    retain:
      default: 14
      mode: active_objects
# added from https://fixtse.com/blog/coral-ia-frigate #

 
snapshots:
  # Optional: Enable writing jpg snapshot to /media/frigate/clips (default: shown below)
  enabled: true
  # Optional: save a clean PNG copy of the snapshot image (default: shown below)
  clean_copy: true #false  #true
  # Optional: print a timestamp on the snapshots (default: shown below)
  timestamp: false
  # Optional: draw bounding box on the snapshots (default: shown below)
  bounding_box: true
  # Optional: crop the snapshot (default: shown below)
  crop: false
  # Optional: height to resize the snapshot to (default: original size)
  height: 768
  #height: 800
  # Optional: Restrict snapshots to objects that entered any of the listed zones (default: no required zones)
  required_zones: []
  # Optional: Camera override for retention settings (default: global values)
  retain:
    # Required: Default retention days (default: shown below)
    default: 5
    # Optional: Per object retention days
    objects:
      person: 7
      cat: 7
      dog: 7
      bird: 7
      fox: 7
      badger: 7
      car: 7
      licence_plate: 7

  # Optional: quality of the encoded jpeg, 0-100 (default: shown below)
  quality: 100

##########################################################
##########################################################
# go2rtc: # this worked from https://docs.frigate.video/configuration/live/#setting-stream-for-live-ui
#  streams:
#    upper_patio:
#    - rtsp://192.168.1.123:554/media=0/channel=1&level=0/track0 # <- stream which supports video & aac audio.
#    - "ffmpeg:upper_patio#audio=opus" # <- copy of the stream which transcodes audio to opus for webrtc
#    restream: true        
#    upper_patio_sub:
#    - rtsp://192.168.1.123:554/media=0/channel=1&level=1/track0 # <- stream which supports video & aac audio.
#    - "ffmpeg:upper_patio_sub#audio=opus"
##########################################################
##########################################################

motion:
  improve_contrast: True

detect:
  width: 640
  height: 360

#record:
#  width: 1920
#  height: 1080

####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################
####################################################################################################################


##################UPPER_PATIO###############################################UPPER_PATIO#############################
##################UPPER_PATIO###############################################UPPER_PATIO#############################
cameras: #########UPPER_PATIO###############################################UPPER_PATIO###########################
  upper_patio:
    enabled: true
    ffmpeg:
      inputs:
      - path: rtsp://192.168.1.123:554/media=0/channel=1&level=1/track0 #level1 = SD 640x360 (checked CORRECT); track0 media=0 are the only working options tested in ffplay
      #- path: http://truenas.local:8082/media=0/channel=1&level=1/track0 # didn't work: two streams avalble from .123 not from motioneye
      #- path: http://truenas.local:8082 # didn't work: two streams avalble from .123 not from motioneye
      #input_args: preset-rtsp-restream

        roles:
        - detect
          

      - path: rtsp://192.168.1.123:554/media=0/channel=1&level=0/track0 #level0 = HD 1920x1080(checked CORRECT);  track0 media=0 are the only working options tested in ffplay
        roles:
        - record

    objects:
      track:
      - person
      - cat
      - dog
      - bird
      - deer
      - fox #placeholder
      - badger #placeholder

    birdseye:
      mode: continuous #continuous | objects | motion
    # masks are black: they block out areas where you aren't interested in detecting things
      order: 1

    motion:
      mask: 0,219,72,169,140,139,146,79,218,73,291,72,362,133,430,143,450,121,488,120,523,98,640,95,640,0,0,0

    zones:
      upper patio:
        coordinates: 640,360,640,337,610,312,603,297,594,279,564,256,524,255,510,242,487,220,451,203,435,201,421,187,409,166,392,152,334,146,274,138,215,142,122,145,78,162,23,202,0,360


######################BLUE_GATE###################################################BLUE_GATE#############################
######################BLUE_GATE###################################################BLUE_GATE#############################
  blue_gate: #########BLUE_GATE###################################################BLUE_GATE#############################
    enabled: true
    ffmpeg:
      inputs:
      - path: rtsp://192.168.1.123:554/media=0/channel=3&level=1/track0   #level1 = SD; track0 media=0 are the only working options tested in ffplay
        #- path: http://truenas.local:8082/media=0/channel=3&level=1/track0 # didn't work: two streams avalble from .123 not from motioneye
        #- path: http://truenas.local:8082 # didn't work: two streams avalble from .123 not from motioneye
      #  input_args: preset-rtsp-restream

        roles:
        - detect
      - path: rtsp://192.168.1.123:554/media=0/channel=3&level=0/track0   #level0 = HD ;  track0 media=0 are the only working options tested in ffplay
        roles:
        - record

    objects:
      track:
      - person
      - cat
      - dog
      - bird
      - deer
      - fox #placehlder
      - badger # placeholder
      - car
      - licence_plate

    birdseye:
      mode: continuous   #continuous | objects | motion
      # masks are black: they block out areas where you aren't interested in detecting things
      order: 2

    motion:
      mask:
      - 0,153,85,148,140,139,239,140,300,142,354,145,398,141,429,141,486,145,518,213,450,226,605,360,640,360,640,0,0,0
      - 479,360,423,337,411,310,390,288,369,268,352,248,340,228,297,223,267,247,231,253,212,204,188,200,152,218,107,227,88,222,73,234,63,250,54,266,45,282,27,292,0,287,0,360

    zones:
      gravel:
        coordinates: 411,273,471,360,523,360,585,360,474,227,473,151,388,141,283,146,228,142,0,151,0,301,296,233

##################DRIVE###############################################DRIVE#############################
##################DRIVE###############################################DRIVE#############################
  drive: #########DRIVE###############################################DRIVE#############################
    enabled: true

    objects:
      track:
      - person
      - cat
      - dog
      - bird
      - deer
      - fox #placeholder
      - badger #placeholder
      - car
      - licence_plate

    ffmpeg:
      inputs:
      - path: rtsp://192.168.1.123:554/media=0/channel=7&level=1/track0 #level1 = SD; changing track0 to track1 didn't work)
      #input_args: preset-rtsp-restream
        roles:
        - detect
      - path: rtsp://192.168.1.123:554/media=0/channel=7&level=0/track0 #level0 = HD ;(changing track0 to track1 didn't work)
        roles:
        - record

    birdseye:
      mode: continuous #continuous | objects | motion
      #restream: True
      order: 4

    motion:
      # masks are black: they block out areas where you aren't interested in detecting things
      mask:
      - 98,129,170,113,189,0,0,0,0,0,0,142
      - 273,0,170,0,178,67,258,117,256,191,414,181,640,307,640,0

    # zones are red: they select areas where monitoring of activity is wanted
    zones:
      driveway:
        coordinates: 78,360,248,360,381,360,640,360,640,276,449,177,303,183,298,129,200,64,144,113,0,127,0,360

########################LOWER_PATIO#####################################################LOWER_PATIO#############################
########################LOWER_PATIO#####################################################LOWER_PATIO#############################
  lower_patio: #########LOWER_PATIO#####################################################LOWER_PATIO#############################
    enabled: true
    ffmpeg:
      inputs:
      - path: rtsp://192.168.1.123:554/media=0/channel=5&level=1/track0   #level1 = SD; track0 media=0 are the only working options tested in ffplay
        #- path: http://truenas.local:8082/media=0/channel=5&level=1/track0 # didn't work: two streams avalble from .123 not from motioneye
        #- path: http://truenas.local:8082 # didn't work: two streams avalble from .123 not from motioneye
       #input_args: preset-rtsp-restream
        roles:
        - detect
      - path: rtsp://192.168.1.123:554/media=0/channel=5&level=0/track0   #level0 = HD ;  track0 media=0 are the only working options tested in ffplay
        roles:
        - record

    objects:
      track:
      - person
      - cat
      - dog
      - bird
      - deer
      - fox   #placeholder
      - badger   #placeholder

    birdseye:
      mode: continuous   #continuous | objects | motion
      order: 3

      # masks are black: they block out areas where you aren't interested in detecting things
    motion:
      mask:
      - 0,148,92,104,184,55,253,0,269,154,272,305,318,125,354,107,345,56,406,60,417,131,504,240,570,360,640,360,640,0,0,0
        #- 0,219,72,169,140,139,146,79,218,73,291,72,362,133,430,143,450,121,488,120,523,98,640,95,640,0,0,0

    zones:
      lower patio:
        coordinates: 284,360,303,183,333,157,344,139,357,118,352,99,359,74,382,73,384,110,403,128,499,246,580,360


logger:
    logs:
      #frigate.record.maintainer: debug
      frigate.object_detection: debug
      #watchdog.blue_gate: debug







#-----------------------END-----------------------##-----------------------END-----------------------##-----------------------END

Relevant log output

Frigate logs - too many lines to include but e.g.

2024-08-03 22:36:03.209639132  [2024-08-03 22:36:03] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-08-03 22:36:03.321537292  [2024-08-03 22:36:03] peewee_migrate.logs            INFO    : Starting migrations
2024-08-03 22:36:03.327466761  [2024-08-03 22:36:03] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-08-03 22:36:03.333727627  [2024-08-03 22:36:03] frigate.app                    INFO    : Recording process started: 451
2024-08-03 22:36:03.336782154  [2024-08-03 22:36:03] frigate.app                    INFO    : go2rtc process pid: 96
2024-08-03 22:36:03.371697327  [2024-08-03 22:36:03] detector.coral                 INFO    : Starting detection process: 467
2024-08-03 22:36:03.376712601  [2024-08-03 22:36:03] frigate.app                    INFO    : Output process started: 473
2024-08-03 22:36:03.572027412  [2024-08-03 22:36:03] frigate.app                    INFO    : Camera processor started for upper_patio: 512
2024-08-03 22:36:03.578960384  [2024-08-03 22:36:03] frigate.app                    INFO    : Camera processor started for blue_gate: 513
2024-08-03 22:36:03.656565254  [2024-08-03 22:36:03] frigate.app                    INFO    : Camera processor started for drive: 516
2024-08-03 22:36:03.664749505  [2024-08-03 22:36:03] frigate.app                    INFO    : Camera processor started for lower_patio: 519
2024-08-03 22:36:03.671430212  [2024-08-03 22:36:03] frigate.app                    INFO    : Capture process started for upper_patio: 521
2024-08-03 22:36:03.758040606  [2024-08-03 22:36:03] frigate.app                    INFO    : Capture process started for blue_gate: 536
2024-08-03 22:36:03.766969041  [2024-08-03 22:36:03] frigate.app                    INFO    : Capture process started for drive: 540
2024-08-03 22:36:03.776241727  [2024-08-03 22:36:03] frigate.app                    INFO    : Capture process started for lower_patio: 546
2024-08-03 22:36:06.132388059  [2024-08-03 22:36:03] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-08-03 22:36:06.154562885  [2024-08-03 22:36:06] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-08-03 22:36:23.956565806  [2024-08-03 22:36:23] watchdog.upper_patio           INFO    : No frames received from upper_patio in 20 seconds. Exiting ffmpeg...
2024-08-03 22:36:23.956573785  [2024-08-03 22:36:23] watchdog.drive                 INFO    : No frames received from drive in 20 seconds. Exiting ffmpeg...
2024-08-03 22:36:23.956577593  [2024-08-03 22:36:23] watchdog.drive                 INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-03 22:36:23.956580900  [2024-08-03 22:36:23] watchdog.upper_patio           INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-03 22:36:23.965946449  [2024-08-03 22:36:23] watchdog.blue_gate             INFO    : No frames received from blue_gate in 20 seconds. Exiting ffmpeg...
2024-08-03 22:36:23.965952959  [2024-08-03 22:36:23] watchdog.blue_gate             INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-03 22:36:24.053875414  [2024-08-03 22:36:24] watchdog.lower_patio           INFO    : No frames received from lower_patio in 20 seconds. Exiting ffmpeg...
2024-08-03 22:36:24.054044836  [2024-08-03 22:36:24] watchdog.lower_patio           INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-03 22:36:31.561669839  [2024-08-03 22:36:31] frigate.video                  ERROR   : upper_patio: Unable to read frames from ffmpeg process.
2024-08-03 22:36:31.562093887  [2024-08-03 22:36:31] frigate.video                  ERROR   : upper_patio: ffmpeg process is not running. exiting capture thread...
2024-08-03 22:36:36.978169598  [2024-08-03 22:36:36] frigate.video                  ERROR   : drive: Unable to read frames from ffmpeg process.
2024-08-03 22:36:36.978456038  [2024-08-03 22:36:36] frigate.video                  ERROR   : drive: ffmpeg process is not running. exiting capture thread...
2024-08-03 22:36:37.957205095  [2024-08-03 22:36:37] frigate.video                  ERROR   : lower_patio: Unable to read frames from ffmpeg process.
2024-08-03 22:36:37.957484981  [2024-08-03 22:36:37] frigate.video                  ERROR   : lower_patio: ffmpeg process is not running. exiting capture thread...
2024-08-03 22:36:38.273280776  [2024-08-03 22:36:38] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-03 22:36:38.273532001  [2024-08-03 22:36:38] frigate.video                  ERROR   : blue_gate: ffmpeg process is not running. exiting capture thread...
2024-08-03 22:36:41.565155681  [2024-08-03 22:36:41] watchdog.upper_patio           ERROR   : Ffmpeg process crashed unexpectedly for upper_patio.
2024-08-03 22:36:41.565305491  [2024-08-03 22:36:41] watchdog.upper_patio           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-03 22:36:41.565539618  [2024-08-03 22:36:41] ffmpeg.upper_patio.detect      ERROR   : Guessed Channel Layout for Input Stream #0.1 : mono
2024-08-03 22:36:41.565706216  [2024-08-03 22:36:41] ffmpeg.upper_patio.detect      ERROR   : Finishing stream 0:0 without any data written to it.
2024-08-03 22:36:41.565958689  [2024-08-03 22:36:41] ffmpeg.upper_patio.detect      ERROR   : Output file is empty, nothing was encoded (check -ss / -t / -frames parameters if used)
2024-08-03 22:36:46.982337241  [2024-08-03 22:36:46] watchdog.drive                 ERROR   : Ffmpeg process crashed unexpectedly for drive.
2024-08-03 22:36:46.982480064  [2024-08-03 22:36:46] watchdog.drive                 ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-03 22:36:46.982832416  [2024-08-03 22:36:46] ffmpeg.drive.detect            ERROR   : Guessed Channel Layout for Input Stream #0.1 : mono
2024-08-03 22:36:46.982835371  [2024-08-03 22:36:46] ffmpeg.drive.detect            ERROR   : Finishing stream 0:0 without any data written to it.
2024-08-03 22:36:46.982837293  [2024-08-03 22:36:46] ffmpeg.drive.detect            ERROR   : Output file is empty, nothing was encoded (check -ss / -t / -frames parameters if used)
2024-08-03 22:36:47.960652649  [2024-08-03 22:36:47] watchdog.lower_patio           ERROR   : Ffmpeg process crashed unexpectedly for lower_patio.
2024-08-03 22:36:47.960766994  [2024-08-03 22:36:47] watchdog.lower_patio           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-03 22:36:47.960934263  [2024-08-03 22:36:47] ffmpeg.lower_patio.detect      ERROR   : Guessed Channel Layout for Input Stream #0.1 : mono
2024-08-03 22:36:47.961042966  [2024-08-03 22:36:47] ffmpeg.lower_patio.detect      ERROR   : Finishing stream 0:0 without any data written to it.
2024-08-03 22:36:47.961152336  [2024-08-03 22:36:47] ffmpeg.lower_patio.detect      ERROR   : Output file is empty, nothing was encoded (check -ss / -t / -frames parameters if used)
2024-08-03 22:36:48.277434750  [2024-08-03 22:36:48] watchdog.blue_gate             ERROR   : Ffmpeg process crashed unexpectedly for blue_gate.
2024-08-03 22:36:48.284342722  [2024-08-03 22:36:48] watchdog.blue_gate             ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-03 22:36:48.284528497  [2024-08-03 22:36:48] ffmpeg.blue_gate.detect        ERROR   : Finishing stream 0:0 without any data written to it.
2024-08-03 22:36:48.284608500  [2024-08-03 22:36:48] ffmpeg.blue_gate.detect        ERROR   : Output file is empty, nothing was encoded (check -ss / -t / -frames parameters if used)
2024-08-04 00:14:58.690872700  [2024-08-04 00:14:58] watchdog.blue_gate             INFO    : No frames received from blue_gate in 20 seconds. Exiting ffmpeg...
2024-08-04 00:14:58.691024663  [2024-08-04 00:14:58] watchdog.blue_gate             INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-04 00:14:59.787063507  [2024-08-04 00:14:59] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-04 00:14:59.787509888  [2024-08-04 00:14:59] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-04 00:14:59.787866202  [2024-08-04 00:14:59] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-04 00:14:59.787986124  [2024-08-04 00:14:59] frigate.video                  ERROR   : blue_gate: ffmpeg process is not running. exiting capture thread...
2024-08-04 00:15:09.788915346  [2024-08-04 00:15:09] watchdog.blue_gate             ERROR   : Ffmpeg process crashed unexpectedly for blue_gate.
2024-08-04 00:15:09.789026105  [2024-08-04 00:15:09] watchdog.blue_gate             ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-04 00:15:09.789139165  [2024-08-04 00:15:09] ffmpeg.blue_gate.detect        ERROR   : rtsp://192.168.1.123:554/media=0/channel=3&level=1/track0: Connection timed out

2024-08-04 09:22:47.042360597  [2024-08-04 09:22:47] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-04 09:22:47.042628478  [2024-08-04 09:22:47] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-04 09:22:47.042859580  [2024-08-04 09:22:47] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.
2024-08-04 09:22:47.043086183  [2024-08-04 09:22:47] frigate.video                  ERROR   : blue_gate: Unable to read frames from ffmpeg process.



go2rtc:
2024-08-03 22:36:01.283757965  22:36:01.283 INF go2rtc version 1.8.4 linux/amd64
2024-08-03 22:36:01.284286248  22:36:01.284 INF [api] listen addr=:1984
2024-08-03 22:36:01.284450694  22:36:01.284 INF [rtsp] listen addr=:8554
2024-08-03 22:36:01.284885271  22:36:01.284 INF [webrtc] listen addr=:8555
2024-08-03 22:36:09.851402027  [INFO] Starting go2rtc healthcheck service...

FFprobe output from your camera

FFPROBE OUTPUT
Stream 0:
Return Code: 0

Video:

Codec: H.265 / HEVC (High Efficiency Video Coding)
Resolution: 640x360
FPS: Unknown

Audio:

Codec: PCM mu-law / G.711 mu-law

Stream 1:
Return Code: 0

Video:

Codec: H.265 / HEVC (High Efficiency Video Coding)
Resolution: 1920x1080
FPS: Unknown

Audio:

Codec: PCM mu-law / G.711 mu-law

Frigate stats

{
  "cameras": {
    "blue_gate": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 4.9,
      "capture_pid": 536,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 292993,
      "pid": 513,
      "process_fps": 4.9,
      "skipped_fps": 0
    },
    "drive": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5.1,
      "capture_pid": 540,
      "detection_enabled": 1,
      "detection_fps": 1.1,
      "ffmpeg_pid": 770,
      "pid": 516,
      "process_fps": 5.1,
      "skipped_fps": 0
    },
    "lower_patio": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 4.9,
      "capture_pid": 546,
      "detection_enabled": 1,
      "detection_fps": 0,
      "ffmpeg_pid": 772,
      "pid": 519,
      "process_fps": 4.9,
      "skipped_fps": 0
    },
    "upper_patio": {
      "audio_dBFS": 0,
      "audio_rms": 0,
      "camera_fps": 5,
      "capture_pid": 521,
      "detection_enabled": 1,
      "detection_fps": 9.2,
      "ffmpeg_pid": 718,
      "pid": 512,
      "process_fps": 5,
      "skipped_fps": 0
    }
  },
  "cpu_usages": {
    "1": {
      "cmdline": "/package/admin/s6/command/s6-svscan -d4 -- /run/service",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "22": {
      "cmdline": "s6-supervise s6-linux-init-shutdownd",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "24": {
      "cmdline": "/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "31": {
      "cmdline": "s6-supervise nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "32": {
      "cmdline": "s6-supervise go2rtc-healthcheck",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "33": {
      "cmdline": "s6-supervise s6rc-oneshot-runner",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "34": {
      "cmdline": "s6-supervise nginx-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "35": {
      "cmdline": "s6-supervise frigate-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "36": {
      "cmdline": "s6-supervise s6rc-fdholder",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "37": {
      "cmdline": "s6-supervise frigate",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "38": {
      "cmdline": "s6-supervise go2rtc",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "39": {
      "cmdline": "s6-supervise go2rtc-log",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "48": {
      "cmdline": "/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "49": {
      "cmdline": "/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "87": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "88": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "89": {
      "cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "96": {
      "cmdline": "/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "104": {
      "cmdline": "python3 -u -m frigate",
      "cpu": "2.4",
      "cpu_average": "1",
      "mem": "2.4"
    },
    "105": {
      "cmdline": "bash ./run.user go2rtc-healthcheck",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "124": {
      "cmdline": "nginx: master process nginx",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "153": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "154": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "155": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "159": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "175": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "202": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "227": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.2"
    },
    "245": {
      "cmdline": "nginx: worker process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "266": {
      "cmdline": "nginx: cache manager process",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "449": {
      "cmdline": "frigate.logger       ",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.6"
    },
    "451": {
      "cmdline": "frigate.recording_manager",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.8"
    },
    "458": {
      "cmdline": "/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(50)",
      "cpu": "0.4",
      "cpu_average": "0",
      "mem": "0.0"
    },
    "467": {
      "cmdline": "frigate.detector.coral",
      "cpu": "4.3",
      "cpu_average": "2",
      "mem": "0.7"
    },
    "473": {
      "cmdline": "frigate.output       ",
      "cpu": "0.8",
      "cpu_average": "0",
      "mem": "0.7"
    },
    "490": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "509": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "510": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "512": {
      "cmdline": "frigate.process:upper_patio",
      "cpu": "7.9",
      "cpu_average": "2",
      "mem": "0.7"
    },
    "513": {
      "cmdline": "frigate.process:blue_gate",
      "cpu": "1.6",
      "cpu_average": "2",
      "mem": "0.7"
    },
    "515": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.3"
    },
    "516": {
      "cmdline": "frigate.process:drive",
      "cpu": "2.4",
      "cpu_average": "3",
      "mem": "0.7"
    },
    "519": {
      "cmdline": "frigate.process:lower_patio",
      "cpu": "1.6",
      "cpu_average": "1",
      "mem": "0.7"
    },
    "520": {
      "cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "521": {
      "cmdline": "frigate.capture:upper_patio",
      "cpu": "0.4",
      "cpu_average": "0",
      "mem": "0.7"
    },
    "536": {
      "cmdline": "frigate.capture:blue_gate",
      "cpu": "0.8",
      "cpu_average": "0",
      "mem": "0.7"
    },
    "540": {
      "cmdline": "frigate.capture:drive",
      "cpu": "0.4",
      "cpu_average": "0",
      "mem": "0.7"
    },
    "546": {
      "cmdline": "frigate.capture:lower_patio",
      "cpu": "0.4",
      "cpu_average": "0",
      "mem": "0.7"
    },
    "548": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=1&level=0/track0 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/upper_patio@%Y%m%d%H%M%S%z.mp4",
      "cpu": "2.4",
      "cpu_average": "2",
      "mem": "0.1"
    },
    "558": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=7&level=0/track0 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/drive@%Y%m%d%H%M%S%z.mp4",
      "cpu": "2.4",
      "cpu_average": "2",
      "mem": "0.1"
    },
    "561": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=5&level=0/track0 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/lower_patio@%Y%m%d%H%M%S%z.mp4",
      "cpu": "1.6",
      "cpu_average": "2",
      "mem": "0.1"
    },
    "718": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=1&level=1/track0 -r 5 -vf fps=5,scale_cuda=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "2.0",
      "cpu_average": "1",
      "mem": "1.0"
    },
    "770": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=7&level=1/track0 -r 5 -vf fps=5,scale_cuda=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "1.2",
      "cpu_average": "1",
      "mem": "1.0"
    },
    "772": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=5&level=1/track0 -r 5 -vf fps=5,scale_cuda=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "1.2",
      "cpu_average": "1",
      "mem": "1.0"
    },
    "288637": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=3&level=0/track0 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/blue_gate@%Y%m%d%H%M%S%z.mp4",
      "cpu": "0.4",
      "cpu_average": "0",
      "mem": "0.1"
    },
    "292993": {
      "cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://192.168.1.123:554/media=0/channel=3&level=1/track0 -r 5 -vf fps=5,scale_cuda=w=640:h=360:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
      "cpu": "1.6",
      "cpu_average": "1",
      "mem": "0.9"
    },
    "299612": {
      "cmdline": "sleep 30s",
      "cpu": "0.0",
      "cpu_average": "0",
      "mem": "0.0"
    }
  },
  "detection_fps": 10.3,
  "detectors": {
    "coral": {
      "detection_start": 0,
      "inference_speed": 9.49,
      "pid": 467
    }
  },
  "gpu_usages": {
    "NVIDIA GeForce GT 1030": {
      "dec": "1.0%",
      "enc": "-1.0%",
      "gpu": "0.0%",
      "mem": "11.88%"
    }
  },
  "processes": {
    "go2rtc": {
      "pid": 96
    },
    "logger": {
      "pid": 449
    },
    "recording": {
      "pid": 451
    }
  },
  "service": {
    "last_updated": 1722803040,
    "latest_version": "0.13.2",
    "storage": {
      "/dev/shm": {
        "free": 46.2,
        "mount_type": "tmpfs",
        "total": 64,
        "used": 17.8
      },
      "/media/frigate/clips": {
        "free": 27752.8,
        "mount_type": "zfs",
        "total": 87040,
        "used": 59287.2
      },
      "/media/frigate/recordings": {
        "free": 27752.8,
        "mount_type": "zfs",
        "total": 87040,
        "used": 59287.2
      },
      "/tmp/cache": {
        "free": 1021.6,
        "mount_type": "tmpfs",
        "total": 1024,
        "used": 2.4
      }
    },
    "temperatures": {

    },
    "uptime": 78477,
    "version": "0.13.2-6476f8a"
  }
}

Operating system

HassOS

Install method

HassOS Addon

Object Detector

Coral

Network connection

Wired

Camera make and model

Eight Chinese (Hikvision or Sannce etc.) clones

Any other information that may be helpful

Frigate is running in some type of a docker "app" on trueNAS Scale

Answered by hawkeye217

Aug 4, 2024

Yes. Transcode your stream on another faster machine with go2rtc. Then in your frigate config file, connect to that external go2rtc instance in your inputs: section for each camera.

View full answer

NickM-27 · 2024-08-04T20:30:38Z

NickM-27
Aug 4, 2024
Collaborator Sponsor

Seems to me it is likely to be an issue with the cameras that is extended as an issue with the Linux boxes. There are many different h264 and h265 profiles. Just because a demo video can be played doesn't mean every type of h265 can be.

VLC also uses different logic than a browser. Most likely though this could be traced bask to cameras having a faulty h265 implementation that some devices are capable of handling while others are not

6 replies

NickM-27 Aug 4, 2024
Collaborator Sponsor

Frigate copies whatever your cameras sends, it does not transcode the streams to a specific codec.

hawkeye217 Aug 4, 2024
Collaborator

I think we may have mentioned this before in another discussion, but it's worth repeating - Frigate does not decode, transcode, or repackage your camera stream that you've set for the record role, which is what the browser displays. The one caveat is if you're using go2rtc to transcode your stream and then pulling from that within your frigate config. Technically go2rtc isn't frigate, but some still confuse this.

If your browser on Linux can't play the h265 streams from your camera but your Android browser can, the Linux browser is your limitation, likely because it does not have support for your particular camera's codec. As Nick said, there are many different h264 and h265 video profiles. It doesn't surprise me that your Linux browser is lagging behind in this area.

So unless you want to dig into decoding and video profile code in your Linux's browser's repo, your best solution is to either transcode or upgrade your cameras to models that support a more common codec.

ElectronicBattle Aug 4, 2024
Author

Thanks for these helpful additions, very much so.

@hawkeye @NickM-27 I remember that we have discussed it before, but Frigate does package some video data into an HLS stream which is what's used for the event video clips:

discussion 12704, comment from Hawkeye:

Live video and recordings playback use two different technologies (MSE, WebRTC, or jsmpeg for live and HLS for recordings playback) and thus two different player types in frigate.

and it's that HLS which seems to be the part which I can't play back in linux//(Chromium or other browsers).

I do now understand that there are many h265 profiles and I agree that diving into the browser innards is going to be a nightmare (and entirely beyond me and off-topic anyway).

I wonder if I can pipe the event video clip HLS stream through ffmpeg, either within the frigate environment or externally, to force the (let's assume) "faulty" camera profile into something more manageable. I know that the direct camera h265 rtsp streams will play in ffplay and mplayer and I will look to see if my browser can render them (a job for tomorrow) seeing as I have just installed some hls/hvec player plugins.

I did ask a couple of days ago if I could feasibly transcode Frigate's output which is sent to (amongst others) my main PC using my main PC's Radeon RX580 but the question wasn't answered because I think I may have confused people.

I don't want to transcode within Frigate because the GPU available on the Frigate box isn't up to the job and anyway I don't need to for several of the clients (Android, LG telly etc.). However I could transcode "locally", i.e. externally to frigate and on the client PC though - is that what you @hawkeye217 mean when you said

your best solution is to [either] transcode

? Also, I presume there's no easy way to get at that HLS stream from the UI so I don't know how I would do it.

Final note - I do appreciate your efforts and all of the help here; I am not doubting what you say, I'm merely trying to catch up and come to an understanding at my somewhat poor beginner's level.

Time for bed!

hawkeye217 Aug 4, 2024
Collaborator

Yes. Transcode your stream on another faster machine with go2rtc. Then in your frigate config file, connect to that external go2rtc instance in your inputs: section for each camera.

Answer selected by ElectronicBattle

ElectronicBattle Aug 5, 2024
Author

@hawkeye217 and @NickM-27 this is excellent information. I am beginning to see the problem from better points of view and I can imagine various solutions which I will pursue with (e.g.) go2rtc github community if needs be, and so on.

Thanks for your patience and help - its difficult to choose which of these answers is "the" answer but I will mark it as answered later today (along with a couple of other "open" questions).

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Support]: How is an "event" video clip constructed ? Full, no-doubt lengthy details requested please! #12762

{{title}}

Replies: 1 comment 6 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

[Support]: How is an "event" video clip constructed ? Full, no-doubt lengthy details requested please! #12762

ElectronicBattle Aug 4, 2024

Describe the problem you are having

Version

Frigate config file

Relevant log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Object Detector

Network connection

Camera make and model

Any other information that may be helpful

Replies: 1 comment · 6 replies

NickM-27 Aug 4, 2024 Collaborator Sponsor

NickM-27 Aug 4, 2024 Collaborator Sponsor

hawkeye217 Aug 4, 2024 Collaborator

ElectronicBattle Aug 4, 2024 Author

hawkeye217 Aug 4, 2024 Collaborator

ElectronicBattle Aug 5, 2024 Author

ElectronicBattle
Aug 4, 2024

Replies: 1 comment 6 replies

NickM-27
Aug 4, 2024
Collaborator Sponsor

NickM-27 Aug 4, 2024
Collaborator Sponsor

hawkeye217 Aug 4, 2024
Collaborator

ElectronicBattle Aug 4, 2024
Author

hawkeye217 Aug 4, 2024
Collaborator

ElectronicBattle Aug 5, 2024
Author