Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Microphone and mWW Improvements #43

Merged
merged 19 commits into from
Aug 8, 2024
Merged

Microphone and mWW Improvements #43

merged 19 commits into from
Aug 8, 2024

Conversation

kahrendt
Copy link
Contributor

@kahrendt kahrendt commented Aug 7, 2024

  • Reading from I2S microphone is in a task
    • Handles the hacked 48kHz audio that triplicates the 16kHz signal in the current 48kHz XMOS firmware
    • Puts left and right channels into separate ring buffers to pass less filtered audio to mWW and the fully clean file to the voice assistant (prepared for a future XMOS firmware update)
    • TODO: These changes really should be under a new microphone platform, not bolted onto the existing I2S microphone
  • mWW runs in tasks instead of in the main loop: one for spectrogram feature generation and another for the actual inference
    • Tasks communicate and are controlled by an Event Group
    • Wake word detection information is passed from the inference task to the main loop using a queue
  • mWW models can be enabled or disabled on the fly. They will automatically be loaded and unloaded as needed
  • mWW will always run unless stopped, even while the assist pipeline is running

I'm holding off merging because I haven't tested it on the 16 kHz XMOS firmware that most people are running. I may have broken the microphone!

This will require a follow up PR after merging to change the external component branch back to dev in the yaml file

@kahrendt kahrendt marked this pull request as ready for review August 7, 2024 19:51
@kahrendt kahrendt enabled auto-merge (squash) August 8, 2024 11:59
@kahrendt kahrendt merged commit 8b1d697 into dev Aug 8, 2024
5 checks passed
@kahrendt kahrendt deleted the kahrendt-20240805-audio-in branch August 8, 2024 12:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant