Python automated process to get content from URL's and put into XML or JSON

£20-250 GBP

已完成

已发布

超过 10 年前

£20-250 GBP

货到付款

I have a big list of URL's which I need to run through so i can get content from the pages. This content is in different tags within the page, not all have classes or ids. I am looking for someone to create an automated service to do this so I can leave it running to complete. I want the automated process to load each page and get the content from particular html tags, then process some this content to ensure the html is correct, e.g. replace table content with paragraph tags making sure all text styling (italic, bold, etc) is kept. If possible I want to generate one or multiple batch XML or JSON files so I can import it into another system. I want this to be able to run off my local mac or a linux server, if worse comes to worse you can run it and provide me with the files. The list of URL's are to an external site. Ideally I would be looking for someone to create this with Python using BeautifulSoup and urllib.request. Only bid if you have experience with this sort of thing. Thanks

Automotive

Python

Software Architecture

XML

项目 ID: 5320937

关于此项目

5提案

远程项目

活跃10 年前

想赚点钱吗？

电子邮箱地址

在Freelancer上竞价的好处

设定您的预算和时间范围

为您的工作获得报酬

简要概述您的提案

免费注册和竞标工作

颁发给：

@ghazalpasha

I've done several scraping jobs with python and can probably do this project without a problem. I usually use python with lxml, but beautifulsoup might be better if the html is too corrupt. Please let me know the website and the details of the scraping job and I will update the bid/time accordingly.

£200 GBP 在3天之内

4.8

(5条评论)

3.0

5威客以平均价£275 GBP来参与此工作竞价

@abbaco

Hello,I'm a PHP and Python developer. I've worked in scrappers before for freelancer.com employers. I've experience working with this kind of application. In my case I like to use content scrapper using XPATH to analyse the site, but in your case I can do it using Beautiful Soap. I've also create it using PHP. I've a lot of them then in PHP if you wish I can adapt one of them to work like you need, this option will be faster than create one from the scratch with python. But is up to you. The output can be on XML file, JSON file, or even I can upload the information to some mysql DB if you wish. I'm online and ready to chat about it or start to work. To start to work I will need some of the URL to check the content. Thanks

£111 GBP 在5天之内