Find Jobs
Hire Freelancers

Stock/finance: Python Selenium scraping and Curses output

$250-750 USD

已关闭
已发布大约 5 年前

$250-750 USD

货到付款
My technical skills have hit a wall. I need someone to finalize my Python-script. It's a script that scrapes 2 sources of stock data, saving to tinyDB and continuously printing to terminal with using Courses. Note: I'm open to refactoring and changing libraries/technologies and such if improvements/stability can be made. To-do: Output/Curses: - Print Curses directly on start - Print and updated all lines continuously using Curses for use in Terminal - Alert on price below base (Ticker name and base) ([login to view URL]) TradingView scraping: - Ongoing scraping, 5-min and 1-hour chart, as long as script runs (Min 2 updates per day) - Multithreaded base scraping for increased speed - Improve base scraping stability (Handle stale elements and 0, N/A bases) Price scraping: Multithreaded price scraping (Updated 2 times per minute) Key technologies used for now: Python Curses Selenium TinyDB
项目 ID: 18890194

关于此项目

15提案
远程项目
活跃5 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
15威客以平均价$491 USD来参与此工作竞价
用户头像
Hello, Dear How are you? I have read your project description and am ready for discussing with you about project for now. I have experienced in developing Python, Selenium Webdriver, Software Architecture, Web Scraping. I will work very hard and best for you. Best Regards
$500 USD 在10天之内
5.0 (79条评论)
7.6
7.6
用户头像
Hello sir I checked the requirement carefully and am suitable for this project. Because I am familiar with Curses, Python, Selenium and Tinydb and have experience in scraping from tradingview. Also I can make a multi-threading. I am ready to start the work. Best Regards, Yongtao
$555 USD 在10天之内
4.9 (128条评论)
7.6
7.6
用户头像
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$500 USD 在5天之内
4.9 (88条评论)
6.9
6.9
用户头像
Hello I'm experienced Python developer and I have strong expertise in building web scrapers. I've checked you script and found several point that we have to discuss in order to create the scraper more effective. Let's discuss it in detail over the chat. Regards, Alex.
$550 USD 在10天之内
5.0 (52条评论)
6.2
6.2
用户头像
Hi there, I took a glance at the code. It's really clear and looks good. However, it's not obvious how many symbols it's going to track which will directly effect the performance. The reason is that unfortunately selenium is not thread safe. For parallel operations and multithreading, you need to spawn several selenium instances and put each one into its own thread. But this way RAM and CPU usage will increase linearly as the number of symbols to track increase. To get the better of both worlds you need to create a queue system and spawn a certain number of instances which will constantly dequeue the symbols, update the price and/or tradingview where another component schedules the symbols to be processed again by putting back to queue. I did create a similar system in c# and it was definitely not fun so if you have a better alternative in mind we should go for that. Still, if the number of symbols to track is low, e.g 10 or something, and since you need 1 update every 30sec. for each symbol that means 1 update every 3sec. which can be handled with a single instance just fine. In this case, above is a total overkill since a single instance will do and please ignore my bid if so, thanks.
$700 USD 在7天之内
5.0 (36条评论)
6.0
6.0
用户头像
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,
$311 USD 在10天之内
4.9 (100条评论)
5.8
5.8
用户头像
Dear, we are Team of French + US. I checked your project description, I can scrap your data. I will focus on user friendly interface. As you can see I have very good rate, you can be sure I am serious. Regards, Fabrice
$277 USD 在10天之内
4.9 (19条评论)
5.8
5.8
用户头像
Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.
$500 USD 在2天之内
4.7 (41条评论)
5.6
5.6
用户头像
Hi, I'm not applying for the project, I simply wanted to have a talk with a fellow trader. I'm curious to hear about your work process and share some ideas and thoughts about strategies and tools. Hope to hear from you, Andy
$555 USD 在10天之内
5.0 (6条评论)
4.0
4.0
用户头像
I believe I am the best candidate for this project as for my experience in selenium. However, instead of using technologies that are operating system limited, I would prefer to use ones that are not. Also, I have not yet done the research to see why you have chosen to use selenium + proxies + user-agents to scrape tradingview. I have an inkling, however, as I am sure you are aware, they do have an api, and I would be inclined to use this rather than selenium. If you would like me to scrape rather than use an api I would be happy to do so. Thank you for your time and consideration. Cody Quist
$750 USD 在15天之内
5.0 (2条评论)
2.8
2.8
用户头像
Ms. Degree, Moscow Institute of Physics and Technology, Appl. Math. Ph.D U of A, Canada, Appl. Math. Tons of algo trading code already written, and not just strategies but systematic quantitative finance such as IS-OOS etc. Very interested in this challenge. Price is negitiable with the client providing valuable interaction and insight.
$400 USD 在5天之内
5.0 (1条评论)
1.1
1.1

关于客户

SWEDEN的国旗
Sweden
0.0
0
会员自4月 19, 2010起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。