Musical BPM detection with adaptive, variable-speed Video-playback

The Project is to create a "Proof of Concept" mini-application (later extendable, of course) - yet, for now WITHOUT any design, menus, user handling, authentication, etc - in which a pre-recorded, High-FPS Mp4 video should be adjusting its on-screen playback speed in real-time, gradually, proportionally to the detected & calculated approximate actual musical BPM ("Beats Per Minute") from the Phone's Microphone. (The Video itself will not have sound, or, at least not for now). Video Playback speed should follow the rhythm / tempo change in real-time.

In plain words - The mini-Application should download (prior to starting the visualization) a High-framerate MP4 Video file from the Client's server, and the use the Microphone to continuously take samples (ie. in every 5-10-20 milliSeconds), to be stored for evaluation in a Sliding-time-Window array, to look for "Volume Peaks" inside which are significantly (ie. min 1.5x) louder than the average Volume of the latest few seconds, count them (by excluding double-detection of the same) Peaks, and then approximate the musical BPM, based on the last few seconds ie. the latest 5 seconds) by counting the Peaks & linearly projecting them up to 60 seconds (BPM).

BPM evaluation & video playback speed variation should be continuous & instantaneous, ie on each new sample taken from the MIC (ie. every 5-10-20 miliSeconds), BPM estimation should be re-calculated, & video playback speed altered, if needed. Since BPM is calculated from a sliding window, averaging BPM over ie. 5 seconds, this should almost never result in sudden "jumps" in BPM and / or correlated Video playback speed.

The Client-provided videos will be short (30-40 seconds), but of relatively high framerate (ie. 60-240 true FPS), so that slowing down the Video should & could will result in very SMOOTH playback, WITHOUT GLITCHES OR JUMPS (ie. a 120 FPS video would still have 15 Frames/ second even if slowed down to 1/8, or 0.125 speed.

The Target video playback speed rate - relative to the calculated BPM - will also be provided by the Client's server, for example (a typical value) would be 1.0x playback speed for 120 BPM, changing linearly (0.5x speed for 60 BPM, 2x speed for 240 BPM), and so on.

The Project is for both Android & iOS, but Android should be prioritized in Milestones as well because it is 10x times more common in the Client's country.

The project will be split up to 4-6 milestones, depending on the accepted bid, to be discussed after granting the job. More technical details will also be available in the Tech Spec document for the selected Freelancer.

For serious bidders, even more detailad technical specification will be available.

Bidders should be deeply familiar with AudioVisual / Multimedia capabilities of both Android and iOS devices, the project might require low-level, Native function calls on both Audio Pre-processing, Audio Sampling, as well as Real-time Video playback speed variations (ie. Speeding up / slowing down a high-FPS video on-the-fly).

Taidot: Audio Processing, Video Processing, Android, iOS Development, Mobile App Development

Tietoa asiakkaasta:
( 4 arvostelua ) Budapest, Hungary

Projektin tunnus: #34808504

Myönnetty käyttäjälle:

(20 Arvostelua)

26 freelanceria on tarjonnut keskimäärin €2700 tähän työhön


Hi there, I have read the details. I see you have been looking for POC where pre-recorded video should be adjusting its on-screen playback speed in real-time. This is something I have experience with and can do. If you Lisää

€3000 EUR 60 päivässä
(72 arvostelua)

Hi please initiate the chat to discuss more about this opportunity. i will assure you for the quality service and support

€3500 EUR 70 päivässä
(103 arvostelua)

Hi. As an Mobile Expert, I can build your app. I am familiar with video stream and BPM estimation I will service you good design. I have mobile and backend skills with 7+ years. I wish to work for you. Thanks for atten Lisää

€2000 EUR 20 päivässä
(28 arvostelua)

Hi there! I can create a "Proof of Concept" mini-application You need a Musical BPM detection with adaptive, variable-speed Video-playback, I have seen the project description carefully send me a message for more d Lisää

€2200 EUR 28 päivässä
(42 arvostelua)

Good Day. Looks like you are tying to download the pre-recorded MP4 video from the server actual musical and sync with BPM ("Beats Per Minute") from the Phone's Microphone. I would like to have an opportunity to d Lisää

€3500 EUR 40 päivässä
(12 arvostelua)

Dear Hiring manager , I have 7+ years of extensive experience with the Android and IOS development with the webservices as well . Our Experience, Expertise & Services : Mobile App Design |Android IOS |Android studio Lisää

€2500 EUR 30 päivässä
(7 arvostelua)

Thank you for looking at our bid. If I understand correctly in the prototype, we can assume audio data in the MP4 file downloaded - (a)Playing the video (b)Sampling the audio using microphone (c)Averaging samples in th Lisää

€2500 EUR 7 päivässä
(2 arvostelua)

♛♛♛ A Talented Mobile App Developer ♛♛♛ [login to view URL] Hello, how are you. I have read your bid carefully. I am Android/iPhone app expert and have full experience for 10+ years. Lisää

€2500 EUR 20 päivässä
(2 arvostelua)

Hello, we have 20 years of experience in design and web development, we can make your App in a hybrid system, based on nodeJS, AngularJS (like IONIC) or ReactJS (like React Native), in other words, with a single develo Lisää

€5000 EUR 60 päivässä
(1 arvostelu)

Hello How are you? I read your job description and I am sure I am good candidate to complete your job very well in given deadline. I am high skilled and rich experienced web & mobile design & development expert for ov Lisää

€2000 EUR 7 päivässä
(5 arvostelua)

Hello, I have read your project on ""Musical BPM detection with adaptive, variable-speed Video-playback"" Project is to create a "Proof of Concept" mini-application (later extendable, of course) - yet, for now WITHOUT Lisää

€2500 EUR 28 päivässä
(8 arvostelua)

Hello, this is Koki from Japan who has been working as a Mobile app development to for the last 8 years. I have checked your project description carefully and I found this project as a good fit to match my skill sets Lisää

€3000 EUR 15 päivässä
(4 arvostelua)

Hi. I can take care of the BPM and I have experience with analysing audio and producing visuals using FFT and other means. I can also work with video synthesis and resembling them based on requirements.

€3000 EUR 20 päivässä
(12 arvostelua)

Hello, We have carefully gone through the mentioned job description and We found ourselves best suited. We can efficiently take care of all of your requirements as We have developers with more than 8+ years of experie Lisää

€3000 EUR 7 päivässä
(7 arvostelua)

have rich experience in React.js with Node.js and integration with React Native and Flutter apps. I am very familiar with handling timeline mobile app for Android and iOS. So I have confidence in this project. As a sen Lisää

€2500 EUR 7 päivässä
(6 arvostelua)

Hello, this is Mitchell from United State who has a very good experience with Mobile app development. I have read your project description in detail and I think I am the good fit for this project. Looking forward to ta Lisää

€3000 EUR 20 päivässä
(3 arvostelua)

Greetings !! Hope you are doing well ! I have 7+ years of experience in Android app development. I go through with the job requirement and I can do this. As encryption of messages is your main requirement I have done Lisää

€2000 EUR 7 päivässä
(7 arvostelua)

Hey, Hope you are fine. I read your project details and understood your requirement. I would like to do this project if you like to accept my proposal. I am expert in Mobile application development and I have developed Lisää

€3000 EUR 7 päivässä
(11 arvostelua)

Hello, I hope this finds you well. I have just seen your project requiring; Mobile App Development Android iOS Development Audio Processing Video Processing I believe that my 10-year experience in this field is what y Lisää

€2500 EUR 6 päivässä
(2 arvostelua)

Audio & Video Processing Expert using AI !!! Hello, I am glad to chance to get this project posting, and i read you description carefully and understood what you need. I am a Senior Image Processing, Audio Processing a Lisää

€2500 EUR 7 päivässä
(1 arvostelu)