Find Jobs
Hire Freelancers

Data Processing Software Architecture

$1500-3000 CAD

已关闭
已发布超过 2 年前

$1500-3000 CAD

货到付款
Purpose This project is a proof of concept of a modern data processing engine that will bring to ingest, explore, prepare, manage, and serve data for immediate BI and machine learning needs. Currently, it is restricted to personal usage only. Scope The purpose of the modern data processing engine is to bring modern data warehousing capabilities with reasonable pricing ease. System Features • At the moment, the system is powered by a spark engine and other components. • Functional Requirements: The system connects to the following data sources.  MS SQL Server  AWS Redshift  Azure synapse  web APIs  Flat Files  Snowflake • The system has query engine capacity using SQL which allows running federated queries on the above-mentioned data sources except for web API. • The system has integrated data processing functionality that allows users to use Apache Spark to process data from the above-mentioned data sources. • The system has directed acyclic graph capability using Air flow. • The system provides a search facility that will allow full text searching of all data in the memory of the engine that the user is permitted to access. The system must support the following searches:  find all words specified.  find any word specified.  find the exact phrase. • The software is built on a framework or architect which lets it run on distributed systems. • Secure impersonation inside its execution model for added security and offers data encryption and masking services. • The system has connectors to share the output to third-party BI tools such as Power BI, or Looker. Job Requirements • Experienced architecting and developing software for scalable, distributed systems. • Understanding the current architecture of the application and assisting in scaling the architecture cost effectively. • Develop orchestration in the application. • Enable users to schedule jobs on the basis of time and event. • Containerization/packaging of the application so the application is not reliant on any local systems. • Cost analysis of current configuration & architecture of the application. • Comparative analysis of applications with various configuration with the same architecture. • Writing efficient and modular code. • Experience with cloud technologies and distributed system servers. • Ability to facilitate demonstrations, proof of concepts. • Deep understanding of spark application. • Able to expertly convey ideas and concepts to others. • Understanding of the public cloud market and pain points driving enterprise cloud adoption. • In-depth understanding and the ability to demonstrate expertise in designing, deploying, and maintaining custom enterprise web applications. • Prepare a high-level PowerPoint presentation and detailed word document of the application on completion of the project. Nice to Have • Strong knowledge of Python Machine Learning standard libraries. • Strong understanding of all commonly used Machine Learning models and the main algorithms that compose the models. • Good understanding of the built-in data types. (Lists, dictionaries, tuples sets).
项目 ID: 32246717

关于此项目

16提案
远程项目
活跃2 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
16威客以平均价$2,597 CAD来参与此工作竞价
用户头像
Hi, This is M Zahid I went through the details of your project and would like to offer our services to deliver the results that you expect and we are sure you will not be disappointed. I got interested in your project.I thought we are very suitedfor your job, and I am crazy with willing to work with you. Our team is experienced, creative & efficient enough to get your job done well. We have expertise in PHP, Laravel, CI, Cake PHP, ZEND, JavaScript, Node, React, Angular, Next, Bootstrap, jQuery, HTML, CSS. Mobile: Android, IOS, REST API Databases: MySQL NoSQL Mongo CMSs: WordPress, OpenCart, Shopify, Magento, Joomla, Drupal, PrestaShop We have expertise in logo & stationary design, brochures and flyer designing, product & merchandise design and designing for social media. We have an impeccable record and all our clients enjoy working with us, we are sure that you will too, our prices are cheapest in market please contact me.
$2,600 CAD 在7天之内
4.9 (29条评论)
6.9
6.9
用户头像
Hi, We at Tecogno Solutions are a team of Passionate Data Science and Full Stack professionals having more than five years of combined experience in multiple areas including Backend, Frontend, Machine learning (ML), Computer vision(CV), and Artificial Intelligence (AI). We have developed and delivered multiple similar projects. We have a strong command over Python, Flask, Django, DialogFlow, Rasa, OpenCV, Google Vision API, Tesseract, Spacy, PHP, MySQL, Software architecture, Tensorflow, Spacy, Twilio, Node.js, RESTful API, NLP, CNN, AWS, GCP, Google API's, etc. Thus we are capable of fulfilling all your requirements and for further information please refer to our profile or visit our website. Looking forward to working with you. Thanks
$3,000 CAD 在7天之内
5.0 (1条评论)
4.7
4.7
用户头像
Hello, Greetings! ___Hope you're reading my proposal, will wait for your positive response.___ ___I'm interested in your project.___ ___I can start the work right away & I assure you for the best quality work.___ I've gone through your job description. I think I can be a good fit for your project as per the skills set & experience required for the project. I'm glad to mention that I have a team of 60+ professionals expertise in web & mobile app development. We are having 7 years of experience in the industry. We have provided business solutions to many clients by developing mobile app & websites for different businesses. We have worked for many startups & entrepreneurs as well. We make use of the right tools & technologies to develop a technologically advanced app. We will first comprehend your business & it's requirement & then we will suggest the right solution with the necessary features. Additional benefits you will get: -- No upfront payment -- Payment in milestones -- Delivery on time -- Write clean, efficient, well-documented code -- Assistance on project handling -- Modern & attractive UI -- SEO friendly solution -- Free support & maintenance after project completion -- Bug free solutions -- Daily & weekly updates Kindly initiate chat so that we can discuss further. Looking forward to hearing from you soon. Thank you for taking the time to read my application. Kind Wishes Appentus Team
$2,600 CAD 在7天之内
5.0 (1条评论)
3.2
3.2
用户头像
Hi, I have very a good understanding of data processing systems, in fact I developed an application which allowed to gather data from 1 million shopify stores, which was used to later to apply machine learning usage. I am confident I will be able to develop this system as well, please send me a message to discuss further details. Thanks
$1,950 CAD 在7天之内
5.0 (5条评论)
3.2
3.2
用户头像
Hi, I’m Senior Data Architect working for Globant company with having many Hadoop ecosystems like HDFS, Spark, Hive, ETL, Azure etc Please contact me for more details
$3,000 CAD 在7天之内
5.0 (5条评论)
2.9
2.9
用户头像
Hey there ! Good day. I am Pankaj Ranga I would like to work with your project and I can surely provide the details you have specified on the project description. I can confidently say that I am knowledgeable enough to finish your required task. I hope I can get response. Thank you ! BEST REGARDS
$2,600 CAD 在7天之内
4.0 (2条评论)
3.0
3.0
用户头像
Hi There, I am flexible with my working hours and would appreciate it if you could discuss your project as soon as possible. I would greatly appreciate the opportunity to be working with you and to discuss my qualifications and your requirements in detail. Thank you !
$2,600 CAD 在7天之内
5.0 (1条评论)
2.0
2.0
用户头像
Hello Greetings for the day, Am a professional freelancer expertized in various MSBI ,Power platform, Python and Azure data tools , with hands-on experience around 5 years in different segments of business, I will provide you the required assistance as per your requirement Requesting to open chat for further discussions. # Kindly have a look at my profile to know better! Regards, Rajkumar
$2,600 CAD 在7天之内
5.0 (3条评论)
1.6
1.6
用户头像
Hi there, I am a Senior Software Engineer, having 9+ years of top experience in .NET Web, SaaS, Database, Migration, API, Library, Services, Reports, Dashboards. I can analyze, design, develop and manage small to large scale applications. I can easily convert your desktop apps to web apps or mobile apps, old language apps to the latest .NET apps. • 2+ Years experience in .NET Core (ASP.NET core 1.1 to 3.2) • 2+ Years experience in Blazor 3.1 • 5+ Years experience in CSS, HTML , Jquery , Angular ,React TypeScript. • 5+ Years experience in MS Access. • 5+ Years experience in nopCommerce. • 5+ Years experience in Umbraco. • 5+ Years experience in Sitefinity. • 3+ Years experience in WPF .NET Applications • 3+ Years experience in Unity 3D C# .NET Applications • 8+ Years experience in C# .NET Applications • 7+ Years experience in SQL Server, AWS, Azure, API Dev • 7+ Years experience as Database Optimization, Reports, Dashboards Expert • 6+ Years experience in Converting Old Version Apps to Latest, Different Technologies • 3+ Years experience in Angular, NodeJS, MongoDB, ASP.Net MVC Zero & Boilerplate • 3+ Years experience in VSTO Add-in for Microsoft Office Outlook, • 3+ Years experience in SharePoint, MS Dynamics CRM 365, Microsoft Office Outlook, Thanks Jitendra
$3,000 CAD 在30天之内
1.9 (2条评论)
3.4
3.4
用户头像
Hello there, Hope you are doing well! I have 5+ years of strong experience as Python Developer. I have expertise with Django, Flask, Python, AI, ML, NLP and Data Science. Can we have a quick chat/call to discuss this opportunity? I would like to show myself expertise and past quality work. Looking forward to hear from you. Thanks & Regards, Nishit Patel
$2,600 CAD 在7天之内
0.0 (0条评论)
0.0
0.0
用户头像
Hello there , i am a full stack software developer having 5+ years experience , i have experience in developing data processing softwares , database softwares, APK softwares , Mobile apps and website , i have completed more then 100+ projects and softwares , please come over the chat , thanks regards Vinod. Recent work - https://www.freelancer.com/u/vinod00k
$2,000 CAD 在7天之内
0.0 (0条评论)
0.0
0.0

关于客户

CANADA的国旗
Brampton, Canada
0.0
0
会员自3月 15, 2021起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。