Ruby on Rails - Real-time processing of media streams to AWS S3

One-sentence Summary: Completion of Ruby on Rails processing of video and animated gif files while streaming to storage on S3.

Background: We currently have a Ruby on Rails application which uses Carrierwave to accept a streaming file (image, animated gif, or video). Carrierwave stores the stream as a file, processes the file, and then uploads it to Amazon S3. This process is too slow for the needs of our customers. We have written a gem (basically a wrapper similar to Carrierwave) which will perform processing of the streaming file as the file is saved directly to Amazon S3.

What is needed:

Processing of still images for this project has been completed. Animated gifs and video is much more complicated, as the application must buffer chunks of the stream coming in, figure out details about the file (frame size, type, other information?), and then perform necessary actions with the stream depending on those details.


Handle animated gifs and videos by "piping" / buffering the beginning of the stream in memory to determine needed information (including, but not limited to frame size, type, etc.). Our application should then handle still images, animated gifs, and video using the same wrapper gem (our Carrierwave re-write), taking roughly the same amount of time for each file type.

Full test coverage of code written using minitest

TL;DR Version™ - Our API is really fast for images, but takes a minimum of several seconds for video, and upwards of minutes to hours depending on how many hours a video could be. We need an hour-long video to be processed just as fast as a still image.


Our development team believes the framework is in place.

The remaining work should not take longer than 30-35 hours to complete for a senior level Ruby / Rails developer.


Senior / Lead-level Ruby on Rails developer.

Experience with Carrierwave.

Experience with Amazon Web Services.

Experience with Docker and docker-compose.

Experience with Minitest.

Ability to work with little guidance and with a remote team.

Must have legal documentation to work in the United States.

Must sign a CIIAA / contracting agreement for work in the United States.


$5000, negotiable with the optimum skill set, payable at milestones to be worked out between the awarded contractor and the company.

TL;DR Version 2.0 ™ - Our API is really fast for images, but takes a minimum of several seconds for video, and upwards of minutes to hours depending on how many hours a video could be. We need an hour-long video to be pre-processed and "piped" to perform separate processing (e.g. concurrent creation of a smaller resolution video, or video at a higher frame rate, etc.) as fast as preprocessing and "piped" to perform separate processing of a still image.

(Yes, I apologize to all of you - the original TL;DR Version™ was written poorly. Sorry for any confusion.)

Taidot: Ruby on Rails

Näytä lisää: ruby rails real time, real time data processing developer, real time credit card processing, real time image processing project using labview, real time application image processing, real time image processing, ruby rails portfolio real time quotes, real time transaction processing matlab code, rails jquery real time search, processing real time stock data, indian aws real time data online, impact real time backup online processing system sql server, ruby rails real time feed, real time credit card processing ukraine, simulation data real time ruby

Tietoa työnantajasta:
( 0 arvostelua ) Lisle, United States

Projektin tunnus: #13130703

37 freelanceria on tarjonnut keskimäärin 4649 $ tähän työhön


Greetings. We are Softices. We have 10+ years of experience with software architecture and development. We are individual experts working together as a team to provide solutions to our client. Our client testimonials r Lisää

4705 $ USD 30 päivässä
(34 arvostelua)

Hi there, I would like to work for this project. I am Software Engineer and professional full-stack Rails developer for more than 5 years. I am going to implement this project from ground according to your specific Lisää

5000 $ USD 30 päivässä
(55 arvostelua)

Hi, this is the kind of work I like to do and I can guarantee I'm the best freelancer for this job.

5000 $ USD 30 päivässä
(34 arvostelua)

Hello, We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore Lisää

5882 $ USD 50 päivässä
(4 arvostelua)

Hi, I am Elton, a web developer with 10+ years of experience. I've worked for big companies, (10 years at [url removed, login to view] [url removed, login to view]) founded a startup as a CTO [url removed, login to view], where i was a developer and also lead a team of Lisää

5000 $ USD 30 päivässä
(12 arvostelua)

Hi, As per the requirements I have created the estimates, please check the URL: [url removed, login to view] I have got rich experience in Lisää

3333 $ USD 10 päivässä
(4 arvostelua)

We are a London (Shoreditch) based Fullstack dev studio. Please get in touch to discuss further. Following are some of our recent projects; [url removed, login to view] a freelancing marketplace built using Ra Lisää

5000 $ USD 30 päivässä
(1 arvostelu)

When I read this job I feel very excited to be a part of your project and share my great experience in software development. My technical skills - PHP, Ruby on Rails, APIs, Node.js, Angular.js, Backbone.js, jQuery, Lisää

4777 $ USD 30 päivässä
(22 arvostelua)

Hello, I want to show you all relevant Demo and Designs which is similar to your project completed previously. To make sure about the requirement set and customizations, I want to discuss this project with you further Lisää

4444 $ USD 30 päivässä
(7 arvostelua)

Hi, I have gone through your job requirement and I am confident that I can help you with your project. I have 8 years of experience working on Ruby on Rails on more than 60 projects worldwide. I am highly skilled an Lisää

5333 $ USD 30 päivässä
(10 arvostelua)

Hi, I am looking for a good opportunity as a developer in Ruby on Rails. I have almost 7 years of experience with Rails development, among other technologies. I have experience working with the following technolog Lisää

4444 $ USD 30 päivässä
(36 arvostelua)

Dear, When I read this job I feel very excited to be a part of your project and share my great experience in software development. I have experience to manage Ruby on Rails developers team. I know thorough how Lisää

4444 $ USD 30 päivässä
(19 arvostelua)
4444 $ USD 30 päivässä
(22 arvostelua)

Good day, sir, how are you? I have double checked your project "Real-time processing of media streams to AWS S3" and applied from my experiences I am confident with the features of your site, since i am a 6 years rai Lisää

4000 $ USD 30 päivässä
(5 arvostelua)

I'm experienced Ruby on Rails developer. Though, I'm not sure if this is possible. In the worst case scenario this would be close to impossible, just due to the fact that by processing video you process (framerate*leng Lisää

4666 $ USD 30 päivässä
(6 arvostelua)

TOP 5th on ([url removed, login to view]) I am a senior Ruby on Rails developer who have experiences for over 10 years. And I have good knowledge with Frontend(HTML/CSS, Javascript/jQuery, Lisää

5294 $ USD 30 päivässä
(1 arvostelu)

Hi, I have 5.7 years of good experience in Ruby on Rails design & Development , I have developed a wide range of websites using Ruby on Rails, DHTML, CSS3, jQuery, Heroku, Github and MySQL ,Postgres ,amazon ec2 Lisää

4444 $ USD 45 päivässä
(16 arvostelua)

Hi, Let me keep this really short as I am sure you would be swamped with proposals! We have been developing/maintaining various web applications in Rails. Mostly these applications are hosted on clouds (AWS/Linode) Lisää

5000 $ USD 45 päivässä
(2 arvostelua)

Hello :) FYI: Ruby on Rails we have used in a complex software we wrote - its ConnectedFleet - GPS flets tracking. We have worked on this for about 2 years and succesfully deployed it for our UK client. Our 4+ years o Lisää

4444 $ USD 30 päivässä
(1 arvostelu)

Hi, I have read your post and understood your requirement. I have great experience working on /Ruby on Rails/PHP/MySQL/HTML5/jQuery/Laravel/Wordpress/Magento/Joomla/Drupal/AngularJS/[url removed, login to view] Lisää

5000 $ USD 25 päivässä
(0 arvostelua)