Find Jobs
Hire Freelancers

C# console app to hit a lot of urls and save response data

$30-250 USD

已完成
已发布超过 9 年前

$30-250 USD

货到付款
c# console app to hit urls from a txt file and save the response header meta data , we need to store each of the name value pairs from the header in to a column so it can be imported to a database or noSQL system. CSV is fine for output I will be hitting about 50K urls so I need the system to be threaded and use a lot of cores for concurrent connections. Ideally this is a setting in the console before it starts. either by setting concurrent requests or number of cores to occupy
项目 ID: 6596321

关于此项目

24提案
远程项目
活跃10 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
颁发给:
用户头像
Hello, I'm Mathieu, a senior C# developer with around 10 years of experience in development with .net framework. I'm also skilled in Asp.Net/C#, WPF, WCF, Winforms, Html4/5, JQuery and much more. I made a lot of multi-threaded applications using ThreadPools or Parallel Framework (4.5). For your application I'd prefer using Parallel because the concurency can be set easilly. I'm new on Freelancer.com so it's quite difficult to get a job as people tend not to trust. But I'll be very grateful if you could give me chance, and you'll not be disappointed because I'm very serious and always want to satisfy 100% ! So please consider my bid. Regards, Mathieu
$50 USD 在3天之内
0.0 (0条评论)
0.0
0.0
24威客以平均价$114 USD来参与此工作竞价
用户头像
Hi, I can make this multi threaded program easily. I will give you a setting form where you can set how many threads you want at a time and output file path. Thanks
$111 USD 在3天之内
5.0 (80条评论)
6.4
6.4
用户头像
Hello, I have 8 years of experience in .Net Technology. I can use multiple threading for your application. thanks Kalpesh
$98 USD 在3天之内
4.9 (63条评论)
5.7
5.7
用户头像
Hi sir, I'm C# expert, and I did many projects like this one, so please let me do it. Thanks Mohamed
$155 USD 在3天之内
5.0 (35条评论)
5.6
5.6
用户头像
Hi Sir, I am ready to work for you.I have 4 years of experience in .net/C#/sql. please see some of my works also check my reviews you will get better idea about my skill.I deliver quality work within time frame. Please visit my profile once. Please see customer feedback of previous work Thanks with regards, Arpit
$100 USD 在3天之内
5.0 (31条评论)
5.5
5.5
用户头像
Hi sir, I'm interested in your project , I'm expert in c# and Microsoft technologies , about the core and thread the .net use threading bool to run the threads and it allocate cores as it want . I look forward to work for you and I will do my best . Thank you .
$90 USD 在3天之内
4.8 (5条评论)
4.0
4.0
用户头像
Hello you! i can do it and finish 4 days. Please let me know.I looking forward on work your project. Thanks!
$105 USD 在4天之内
4.8 (16条评论)
3.8
3.8
用户头像
Hi , I have done this kind of httpRequest projects a lot, because I work in a project where we have lot of Rest service calls, Saving responses and so on. Sure I can use threads. Please contact me for further details. Hope to work with you. Thanks, Ruwan
$111 USD 在3天之内
5.0 (8条评论)
3.4
3.4
用户头像
I just wrote this in a short program. The 2 day timeline is just so I can make sure I understand exactly what you need in the form of output (which columns for CSV). The number of cores for optimization/parallelism can't be set specifically in .NET as that's a machine-code instruction, but I did parallelize it relatively easily by making the URL loop (one for each URL) reside in a Parallel.ForEach. If you don't want to peg the processor, a max number of concurrent clients is relatively straight forward to do. Since the WebClient class hosts most of this functionality, it's a few hours work to adjust it to the input/output you want. Since you've hired me in the past I got this project via email; it looked interesting so I coded it out to see if I could do it pretty quickly, and it turns out it's a relatively short program to make it work. Best of luck in your search!
$100 USD 在2天之内
5.0 (7条评论)
3.4
3.4
用户头像
Hello, I read through the job details carefully and I am sure that I can do the project very well. I would love to start working on your project as soon as possible. Best regards, pragmatechdev
$90 USD 在3天之内
5.0 (8条评论)
3.1
3.1
用户头像
Hi, billy01 i worked with you before in C# programe that get img tages not containg alt attribute i am expert in scrapiing jobs most of my work here is scraping work can do thiis console application using c# payment after job completion by milestone waiting your answer Regards
$100 USD 在2天之内
4.9 (8条评论)
3.1
3.1
用户头像
Hi My name is Hoai. I come from Viet Nam. I fluent with C# and can do your job. Pls contact me. Thank
$250 USD 在5天之内
4.2 (2条评论)
1.2
1.2
用户头像
I have worked in multithreading and content-fetching from website. This project is doable for me. Please let me know if you are interested or you would like to negotiate on the bid amount
$55 USD 在2天之内
5.0 (1条评论)
0.7
0.7
用户头像
I have 5 years of programming experience. I can help you solve this problem. When you work with me you will feel very comfortable.
$90 USD 在3天之内
4.0 (1条评论)
0.4
0.4
用户头像
Hello, I am a .net developer with 4 years of experience in asp, ado, c#, vb.net and Sql server. I will arrange the order without problems within a specified period. If you would be interested in my offer plese give me more information about the job.
$50 USD 在3天之内
5.0 (1条评论)
0.0
0.0
用户头像
Hi Bill, I've worked with you before on Json Console App. I'm able to do it in the same day you accept bid. Thanks.
$55 USD 在0天之内
0.0 (0条评论)
0.0
0.0
用户头像
Hello, I have many years of experience with C# and multithreading. I can create this application for you in a couple of days if t all the requirements are in the project description. If you have more, we could discuss about a better price that could fit between us. Regards, Jacobo
$222 USD 在2天之内
0.0 (0条评论)
0.0
0.0
用户头像
A proposal has not yet been provided
$111 USD 在12天之内
0.0 (0条评论)
0.0
0.0
用户头像
Dear sir , I am a .NET developer I can do your project if I have the chance , lets talk in details and start Regards Tariq
$188 USD 在3天之内
0.0 (0条评论)
0.0
0.0
用户头像
70 $ and i have it ready and tested. So i can send you the project in 0 days. Best regards Krastan Petrov
$77 USD 在0天之内
0.0 (0条评论)
0.0
0.0
用户头像
I have the basic framework to hit the URL and write the name-value pairs from the headers to a CSV file. It can be delivered within a couple of days of your order. r There are a few questions to be addressed. Some header values have comas(,) within the contents hence we cannot have the output as a CSV file. We need to have some other delimiter like (=>) to identify the columns in the output file. How do we connect the HEADERs with the URL, shall we have the URL as another column, it will repeat for several rows. For using large number of processor cores, the application itself do not have any control and cannot select the number of cores to be used, it OS that decides how much of processor time to be allocated depending on the process running and their priority. We can create a threadpool object within the application. You can set the MAX and MIN threads for the threadpool. VS2012 provides another way to handle parallel running of tasks i.e. ASYNC and AWAIT, with these objects the main thread will not be blocked the application will be very responsive to user actions. Another important issue we need to consider is some of the URLs may fail with certain exceptions, what do we do with such URLs, log into a separate file all such cases?, we can chat over Skype and discuss all such issues to be resolved.
$111 USD 在5天之内
0.0 (0条评论)
0.0
0.0

关于客户

UNITED STATES的国旗
Austin, United States
4.9
454
付款方式已验证
会员自5月 9, 2004起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。