Find Jobs
Hire Freelancers

Scrapy/Selenium (Python) to extract texts and files(specific webpages) based on keywords.

$250-750 USD

已完成
已发布大约 5 年前

$250-750 USD

货到付款
I need to make a Python script (Scrapy or Selenium, I am up to suggestions) to extract information within some specific(I have around 12) websites - daily(auto) or manually. The pages are in portuguese, but I can guide you into the key input-fields and key-pages to look for. 1. User input: - Time period (if the page has this feature) - Website to scrap. - Keywords(can be a list of words) to look for. - User chooses the local path to the files to be downloaded. 2. Back-end: - Access the page. - Searches the tabs that can have useful information(I will provide the specific parts for each webpage to make the queries) links inside that domain. - Download(if the page serves files in doc, html or pdf) and look for the keywords. - Extract all the related content (files or the text in html). - Go around Captchas(if the page has captcha) 3. Logging: - All the extracted content must have the URL which the information/file is available in the webpage - can be done by logs. - All the extracted content must have the DATE which the scrapping has been made - can be done by logs. 4. Configuration: - All key-fields (like CSSSelector for a date field) should be configurable for each spider. - The URL to start scrapping each webpage should be configurable. - If page contains Authentication(Login/Password), user will fill the configuration for it. IMPORTANT: 1. My plan is to pay for each 4 mapped websites (so total project is for 3 "packs" of websites) 2. The content in few cases will need to be extracted from images. 3. Start your bid with the word forward, so I can know if you did read all the description. 4. If you can't extract properly the content I can give you another one to replace that one, so you still need to deliver 4 websites per milestone. 5. I WILL RELEASE THE MILESTONES ONLY AFTER YOU SEND ME THE CODE AND I AM TOTALLY SATISFIED (I WILL RUN TESTS TO CHECK FUNCTIONALITY). I have many projects at hand and would be great to stablish a good relation with you, since I constantly need someone to work with me. Thank you.
项目 ID: 19212037

关于此项目

27提案
远程项目
活跃5 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
颁发给:
用户头像
Hi there, I am interested in your project. I would approach your project by using Python with Scrapy. The website will be written in Python with Django. Here is a demo project: Price tracking system: [login to view URL] I have 4+ years’ experience at Web scraping. If you'd like to view my previous work, take a look at my profile https://www.freelancer.com/u/etuannv or check some demo videos here: [login to view URL] Thank you!
$250 USD 在10天之内
5.0 (105条评论)
6.8
6.8
27威客以平均价$608 USD来参与此工作竞价
用户头像
Hi! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can complete your project and extract data from the sites you need. Please contact me to discuss project details, Best regards, Vlad
$748 USD 在7天之内
4.9 (62条评论)
7.7
7.7
用户头像
Forward Hi there,I am Python Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$705 USD 在10天之内
4.9 (133条评论)
7.5
7.5
用户头像
Hi Can you provide the sites so i can analysis them? Thanks
$800 USD 在5天之内
5.0 (114条评论)
7.6
7.6
用户头像
forward Hello sir I have 9 years of experience about web scraping and have made 200+ crawlers with python. I have fully understood the project and I am confident. I can start the work right now. Best Regards, Yongtao
$588 USD 在10天之内
4.9 (127条评论)
7.6
7.6
用户头像
forward I've read your requirements about User Input,Back-end,Logging and Configuration. I have a good experience with selenium and python. Recently,I've developed B*T for Telegram. That acts like human 100% exactly.(Login,Follow,Post article,Direct Message etc) And no Instagram APIs are used. So I can do your project with high quality and I am sure you will be satisfied with it. Please let me ask a few questions kindly over chat. King Regards.
$1,000 USD 在10天之内
5.0 (17条评论)
6.1
6.1
用户头像
Hello! I have 2 years of experience in web scraping using Python and I'm interested in your project. I can use both Selenium and Scrapy depending on what is better for certain website. Also I can handle logins, file downloading, etc. Would you be so kind to provide me with some more details about your project, please (website URLs)?
$600 USD 在10天之内
5.0 (38条评论)
5.9
5.9
用户头像
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,,,
$444 USD 在10天之内
4.9 (93条评论)
5.7
5.7
用户头像
Hello. I have good skills in "Data Scraping, Python, Scrapy, Selenium Webdriver, Web Scraping". I have working for 7+ years in this field. I 'm very interest to your project. I have checked your project description carefully and i can do it. I 'll do my best till you satisfy if you want me. Contact me please. Thank you. Yang L.
$250 USD 在3天之内
4.9 (35条评论)
5.3
5.3
用户头像
Hi, I am a senior selenium/python expert and I can build the script as requirements in the description. I have 7+ years of professional experiences in web development. I can start immediately, also finish your project within the deadline. My skills has been certified by this platform. Please feel free to send me a message and discuss the project. Looking forward to working for you soon. Regards.
$750 USD 在7天之内
5.0 (4条评论)
3.8
3.8
用户头像
I am an experienced developer with close to 5 years experience in Automation,Python,Scrapy,ASP.NET MVC and Web Forms,Web API work in the present. I also have a wealth of experience developing for a dynamic and responsive client side using advanced JavaScript frameworks such as Angular JS, and CSS/HTML frameworks such as Twitter Bootstrap.
$555 USD 在10天之内
5.0 (2条评论)
3.2
3.2
用户头像
Hi, Thanks for your job posting. I've read your project description carefully. You are going to build scrapy that gets data based on keywords. As a senior scraping developer, I have rich experience in scrapy and python selenium . I am sure I can handle this project as you expected. If you have desire to work with me, please respond me to discuss more. Thanks.
$500 USD 在10天之内
4.2 (8条评论)
3.8
3.8
用户头像
I have more than 6+ years of experience into IT field. Since last 6 years, I am dealing with different kind of field such like : - Laravel, CI, YII - Angular.js - Node.js - Ionic Framework - PHP - HTML - Python - Django - PostgreSQL - Microsoft.net - SharePoint 2013, 2016 & Office 365 - WordPress - Magento 1 & 2 - CSS - Info path & Microsoft powerapps - MS Power BI reporting - Graphics designing (UX/UI) - Logo Design - Custom development with PHP - Amazon & eBay API - Mobile application development with native iOS and Android, Ionic, Phonegap. - I have also experience with Software Testing & App Testing. When you work with me, you can expect high quality results, clear and ethical communication, attention to detail, an eye for aesthetics, and a personalized, professional and friendly service. Looking forward to working with you!
$666 USD 在10天之内
4.0 (2条评论)
4.1
4.1
用户头像
HI, how are you? I have checked your description carefully. I can say I understood fully what you want. As I have rich experienced in python(2, 3) so that your project is not problem for me. I am really confident and would like to discuss further more details with you. I am waiting for your positive reply here. Thanks so much.
$777 USD 在10天之内
5.0 (1条评论)
2.8
2.8
用户头像
Hi I am an engineer on applied mathematics.I scraped many websites to constitute databases valuable for my researchs.I can develope spiders very well in object oriented approach.
$277 USD 在10天之内
5.0 (3条评论)
2.3
2.3
用户头像
Forward Web scraper - 250$ Captcha go-around - 350$ Packaging - 50$ I am gonna need following: - regular communication to clear queries - login credentials for those websites
$722 USD 在15天之内
0.0 (0条评论)
0.0
0.0
用户头像
hi i am having rich experience in python, selenium and web scraping Relevant Skills and Experience python, selenium and webscrapping
$555 USD 在10天之内
0.0 (0条评论)
0.0
0.0
用户头像
I am pleased to inform you that our offering of Crawling Solutions will be the right solution to comply to your requirement. The functionalities of Scraping / Crawling Solutions is as mentioned below, - Fetch the details targeted websites in quick time - More than 98% accuracy in scraping the information - Provision of IP-Management and de-captcha resolution - More than 10 years of experience in industry domain - User defined output to be delivered i.e. excel / csv, JSON, HTML etc. - Output delivery via Email, FTP, API etc. Do let me know if you require further details from our side. We have experience in fetching the pricing and other information on a regular basis from more than 250 websites on a regular basis. The partial list of the websites are as mentioned below, - LinkedIn - Facebook - Twitter - Yellowpages - Super pages - Amazon - Ebay - Rakuten - Wallmart - Insight - Kikatek - CDiscount - Sephore - Bechtel - Farfetch - Zoho - Mouser - bestbuy - officedepot Do let me know if you require further details from our side.
$650 USD 在10天之内
0.0 (0条评论)
0.0
0.0
用户头像
Hi, I have good experience using selenium and BeautifulSoup with python. I should be able to meet all of the requirements you have listed. Look forward to hearing from you, Rhys
$777 USD 在10天之内
0.0 (0条评论)
0.0
0.0

关于客户

BRAZIL的国旗
FORTALEZA, Brazil
5.0
7
会员自1月 18, 2010起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。