$400. Make a browser of database metadata and sftp metadata.
Looking for intermediate developer. I'm a developer too but more for python than golang.
Golang package with CLI and web interface.
Design goal: for any url passed into the app it returns metadata or content of object.
Design goal2: given a table of connections the app creates each connection using golang concurrency and returns success or error message for each connection.
Design goal3: make sure responses are easy to consume in Python pandas, Talend, Google Chrome
Phase 1:
Return metadata for mysql, oracle, sftp in csv format with header.
Must be able to securely store connection credentials like passwords and ssh keys, trusted certs.
Phase 2:
Return metadata for any zip, jar, tar, or local file system. List all the files, folders inside each object.
Acceptable dependencies:
Papaparse: [login to view URL]
Beego: [login to view URL]
Hugo: [login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
Example URL and response:
mavgo:jdbc:mysql://localhost:3306/sonoo returns a csv table of all the objects in database sonoo
type
name
fields
rows
table
customers
24
34000
view
books
22
45000000
function
h
mavgo:jdbc:mysql://localhost:3306/sonoo/books returns a csv table of all the objects in the view books:
title
pubdate
author
edition
pages
subtitle
isbn
...
7 Habits
19890105
Covey, Stephen R
4
241
Habits that define a life
1234123-23-23423
Fargo
20031201
Hemsworth, S
1
454
A broken culture
2342-11111
...
mavgo:sftp://talendagent@[login to view URL] returns csv of all the files and subfolders found inside the folder ‘inbound’
path
name
type
size
moddate
/inbound/movies
folder
20190304
/inbound/movies
[login to view URL]
dvi
4234234234
20190228
Run Environments:
Google App Engine Go Standard
Macbook Pro.
Config URLs and URL Design
mavgo:sftp://talendagent@[login to view URL]
Example chrome:settings
Examples:
mavgo://settings renders configuration at the highest level of the app.
mavgo:sftp://settings shows settings for any kind of sftp connection.
mavgo:sftp://[login to view URL] shows settings
mavgo:
Experiments
How to get as many settings from Google Chrome as possible?
Use the Chrome Browser Sign-in as the default credentials for any connection that’s missing credentials
Use the CTRL-F for as the default search ascross a response.
Upgrade CTRL-F to include paginated results.
Does Chromium have default buffering settings when a page is so big it has to be paginated?
Design Questions that Drive Mavgo Data Browser
How do we upgrade Chromium to be the ultimate Data Browser without rebuilding any existing Chrome Features?
Have you ever noticed that Chrome doesn’t handle so many datatypes out of the box. If you ope
Reference for Good Design
Will have to violate several of these usually awesome design rules to create consistent behavior: [login to view URL]
Advanced Features: Data Query Versioning
#new
#upsert
mavgo:sftp://talendagent@[login to view URL] shows only new content since last pull of same connection and query
mavgo:sftp://talendagent@[login to view URL] shows new content and files or folders that have been modified since last connection query
Hi this seems to be a very interesting project and I would like to be a part of this project.
I have developed numerous Golang projects.
I have designed many backend APIs in Golang. I also have developed quite a few Microservices based projects.
I would love to discuss more about the project with you.
Hello! Nice to meet you! I am interested in your project. I have a lot of experience of data processing. I want to cooperate with you. Tell me your opinion. My regards.