[WIP] Beats Detect & Replace
Moderator: andyp
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
[WIP] Beats Detect & Replace
My journey to create a stroke sound track continues… This is Work In Progress.
Following my experiments with Kerkersklave's Beatmeter Generator and Reaper posted here:
viewtopic.php?p=319704#p319704
I actually got nowhere using tips provided by fellow creators. Either I lack brain cells to understand solutions I'm being proposed, or I lack brain cells to find out if the added sound is before, on, or after the music beat/metronome.
So, I told to myself: Why not doing it from scratch? So I studied the WAV file format, and loaded it into memory to see how complicated beats are. Here's the graph of Kerkersklave's click.wav file. It's the actual data samples imported into an Excel file.
It looks exactly like waves displayed in video and audio softwares, but I have the raw data to work with. Now I need to find a way to detect the beat peak, apply the same principle to the whole music track, and replace all beats with the sample beat. Wish me luck!
PS: I'm not sure but this could perhaps be interesting to those creating an estim track too.
Following my experiments with Kerkersklave's Beatmeter Generator and Reaper posted here:
viewtopic.php?p=319704#p319704
I actually got nowhere using tips provided by fellow creators. Either I lack brain cells to understand solutions I'm being proposed, or I lack brain cells to find out if the added sound is before, on, or after the music beat/metronome.
So, I told to myself: Why not doing it from scratch? So I studied the WAV file format, and loaded it into memory to see how complicated beats are. Here's the graph of Kerkersklave's click.wav file. It's the actual data samples imported into an Excel file.
It looks exactly like waves displayed in video and audio softwares, but I have the raw data to work with. Now I need to find a way to detect the beat peak, apply the same principle to the whole music track, and replace all beats with the sample beat. Wish me luck!
PS: I'm not sure but this could perhaps be interesting to those creating an estim track too.
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
Re: [WIP] Beats Detect & Replace
(This post is left blank in case I release the app.)
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
Re: [WIP] Beats Detect & Replace
I'm not sure if you've looked into this, but it looks like you're just recreating drum replacement software like this. https://youtu.be/fL_Vum5krbE
There is a free version of Studio One that probably has the drum replacement capabilities in this video. There's also other free programs for drum replacement. You can also do it in most audio editing software.
-Batman
There is a free version of Studio One that probably has the drum replacement capabilities in this video. There's also other free programs for drum replacement. You can also do it in most audio editing software.
-Batman
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
Re: [WIP] Beats Detect & Replace
Exactly!
I'll try this Studio One feature to see if it works with beats mixed with vocals. At least, it's free to try.
As they say, Thanks Batman!
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
Re: [WIP] Beats Detect & Replace
In the end, this proposed solution was a total failure. The free version called Studio One Prime doesn't have the Audio Bend toolbar, so can't be done.
So, I'm back to square 2 (cause my square 1 is already done).
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
- masperturbator
- Explorer At Heart
- Posts: 207
- Joined: Sat Jun 22, 2019 5:01 pm
- Gender: Male
Re: [WIP] Beats Detect & Replace
You're trying to find beats (something like transient detection), calculate bpm (tempo) by using the distance between detected beats over time, and generate a second WAV file that is a pattern made by sequencing and looping smaller WAV files according to the detected tempo of the input file (a song.)
I would bet that Github will have some beat detection software that can do the tempo part.
Then, the parts you're missing are specific to what a beat meter is. You will need to be able to input a time signature (measure) so that your one-beat WAV file can be made into patterns that will loop, because no beat meter (beyond 1 stroke per tempo beat) is logically possible without the meter author (a program in this case) having some concept of a bar.
I would bet that Github will have some beat detection software that can do the tempo part.
Then, the parts you're missing are specific to what a beat meter is. You will need to be able to input a time signature (measure) so that your one-beat WAV file can be made into patterns that will loop, because no beat meter (beyond 1 stroke per tempo beat) is logically possible without the meter author (a program in this case) having some concept of a bar.
-
- Explorer At Heart
- Posts: 139
- Joined: Sat Jan 23, 2021 8:39 am
- Gender: Male
- Sexual Orientation: Open to new ideas!
Re: [WIP] Beats Detect & Replace
If I rephrase to see if I understood...
You want to detect the beats of a sound track (music with voices + other noises potentially), which is different from detecting the BPM. Then, you want to be able to replace the original beats by a sound of your choice.
Is this right? In this case, it's far from obvious, it's even a research topic for signal processing researchers. Deezer has recently provided a library (Spleeter: https://research.deezer.com/projects/spleeter.html) quite innovative in this field to extract drums (for instance). I wanted to play with this to make beatmeters, but it doesn't work very well... I extracted the drums with Spleeter and used a beat detection library (ADTlib https://github.com/CarlSouthall/ADTLib). It's far from working...
You want to detect the beats of a sound track (music with voices + other noises potentially), which is different from detecting the BPM. Then, you want to be able to replace the original beats by a sound of your choice.
Is this right? In this case, it's far from obvious, it's even a research topic for signal processing researchers. Deezer has recently provided a library (Spleeter: https://research.deezer.com/projects/spleeter.html) quite innovative in this field to extract drums (for instance). I wanted to play with this to make beatmeters, but it doesn't work very well... I extracted the drums with Spleeter and used a beat detection library (ADTlib https://github.com/CarlSouthall/ADTLib). It's far from working...
Fuck Heroes : sex in rythm for couples (or solo).
Anal Queen's Journey : a long term incremental game, anal centered webtease for gals and guys.
My ranks : Ultimate anal godess (tight), Ultimate anal godess (loose), Ultimate anal godess (gaping), Ultimate anal godess (destroyed), Stellar anal black hole (672)
Anal Queen's Journey : a long term incremental game, anal centered webtease for gals and guys.
My ranks : Ultimate anal godess (tight), Ultimate anal godess (loose), Ultimate anal godess (gaping), Ultimate anal godess (destroyed), Stellar anal black hole (672)
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
Re: [WIP] Beats Detect & Replace
Exactly!nebworx wrote: ↑Fri Apr 01, 2022 10:07 am If I rephrase to see if I understood...
You want to detect the beats of a sound track (music with voices + other noises potentially), which is different from detecting the BPM. Then, you want to be able to replace the original beats by a sound of your choice.
Extracting/isolating a drum from noise is certainly interesting for musicians (what Deezer seems to be experimenting with?), but I don't care for that sound for this project, only its precise position (so it can be replaced by a new sound in an empty track). I downloaded a paper on beat detection. It's Ph.D. level with complicated math, mentioning harmonics, way way over my head.
Seeing the harmonics in the above Excel file, I thought I could simplify things by concentrating on the top envelope shape, and assume that an up-down bump for a specific duration/height should be considered a beat, thus adding some little configurable parameters to the algorithm making it more precise/convenient.
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
- eXquisite
- Explorer
- Posts: 28
- Joined: Sun Feb 06, 2022 1:32 pm
- Sexual Orientation: Bisexual/Bi-Curious
Re: [WIP] Beats Detect & Replace
If you want to easily export timestamps of the beats you can try using Audacity. It has a feature under "Analyze" -> "Beat finder..." that will mark all the beats that you can quickly export to txt file. You would need to find a way to add new beats in the exported timestamps anyway, but I thought it might be close to something you are trying to achieve.
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
Re: [WIP] Beats Detect & Replace
I'm not familiar with Audacity. About these marks, can they be transfered into another Audacity track, an empty one? and then systematically add the stroke beat to each mark? That would be exactly what I want to achieve. And if so, I'll test if the detection works when beats occur during lyrics.eXquisite wrote: ↑Fri Apr 01, 2022 8:05 pm If you want to easily export timestamps of the beats you can try using Audacity. It has a feature under "Analyze" -> "Beat finder..." that will mark all the beats that you can quickly export to txt file. You would need to find a way to add new beats in the exported timestamps anyway, but I thought it might be close to something you are trying to achieve.
EDIT:
The beat detection is a little hit&miss, but it's pretty close. I tried different thresholds, but I'm not sure of its effect other than the number of generated label markers. Thanks for the suggestion.
I see a possibility to add VST pluggins. Some are made just for beat detection...
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
- IrishNachos
- Explorer
- Posts: 44
- Joined: Mon Jan 07, 2019 5:30 am
Re: [WIP] Beats Detect & Replace
For Vegas Pro I've found using the Vegasaur plugin works pretty good for beat detection. It's not perfect but pretty, pretty, pretty good.
IN
IN
- doremi
- Experimentor
- Posts: 1219
- Joined: Sat Apr 23, 2016 11:09 pm
- Gender: Male
- Sexual Orientation: Straight
- Contact:
Re: [WIP] Beats Detect & Replace
That Vegasaur is not too $much, but not free, so I continue searching. Thanks for the suggestion!
I'm on this too.
Cock Hero Database (on the ice atm) - https://www.ch-db.club/ -
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
[APP] Cock Hero Slideshow Player - Thinking about a script feature for [APP] Cock Hero Video Player
If your video is too fat, there's a solution!
- Spoiler: show
Re: [WIP] Beats Detect & Replace
I imagine this will be really helpful for everyone. Thanks for taking on this project doremi!
beauty lies in perception
creator for:
The Moderatoris 1
The Moderatoris 2 - Realm of Dreams
The Moderatoris Archives
creator for:
The Moderatoris 1
The Moderatoris 2 - Realm of Dreams
The Moderatoris Archives
Who is online
Users browsing this forum: Baidu [Spider], golgafrincham, HotBen and 73 guests