Voice optimization audioProcessor for Livekit

Getting Started
1

I’m a sound-engineer and I have developed an open source voice optimization processor wasm:

What would be the best practice way to make it available to the public for use in their livekit apps?

I have not found much documentation on audioProcessor packages or the like, so any help would be much appreciated :slight_smile:

2

I will share this with our client team.

1 Like
3

Any news here? :wink:
Help would be much appreciated!

4

I went down a bit of a rabbit hole looking into LiveKit and BigBlueButton integration. Beyond the source code, we don’t have any other documentation on the low level audioProcessor packages I’m afraid.

5

can they make their own track processor and publish them ?

Yes, it would work like any other npm package

We currently do not have any good guidelines on how to do this. We do have this track-processors-js reference, but unfortunately, it is only a video in that example. I still think it will be instructive to show how the integration would work.

You bring up a good point that it should be easier for folks to know how to do this. I am going to try to write up some documentation on how it would be done generally. Maybe we can work together to clarify the processor so it is easier next time.

1 Like
6

Thanks a lot for hinting to the video track processor - I will look into it!

I’d be very happy happy to work with you on this as an example for folks to make their own processors easily! Feel free to DM me :slight_smile:

1 Like
7

Have a look at this pull request and see if this helps:

2 Likes
8

@klaus The audio example is here. I think that should help you understand how to do the work you were mentioning.