Map Reduce 工作与竞赛

Map Reduce is a programming model created to process big data sets. It's oftentimes utilized in the act of distributed computing for different devices. Map Reduce jobs involve the splitting of the input data-set into different chunks. These independent sectors are then processed in a parallel manner by map tasks. The framework will then sort the map outputs, and the results will be included in "reduce tasks." Usually, the input and output of Map Reduce Jobs are kept in a file-system. The framework is then left in charge of scheduling, monitoring, and re-executing tasks.

Map Reduce can be used in jobs such as pattern-based searching, web access log stats, document clustering, web link-graph reversal, inverted index construction, term-vector per host, statistical machine translation and machine learning. Text indexing, search, and tokenization can also be accomplished with the Map Reduce program.

Map Reduce can also be used in different environments such as desktop grids, dynamic cloud environments, volunteer computing environments and mobile environments. Those who want to apply for Map Reduce jobs can educate themselves with the many tutorials available in the internet. Focus should be put on studying the input reader, map function, partition function, comparison function, reduce function and output writer components of the program.
注册并开始赚钱
注册来开始赚钱。 您是a Map Reduce Developer吗?您可以从这些工作中获得报酬!

浏览Freelancer上的工作

项目/竞赛 描述 竞标数/参赛作品数 技能 已开始 结束 价格(HKD)
Hibench Installation for hadoop and spark and sum of integers program in spark I need screen shots of hibench benchmarks for hadoop and spark for wordcount and run spark sum of integers file 4 Hadoop, Map Reduce, Spark Dec 16, 2017 今天6天 10时 $859
Tutor for Basics I'm looking for a tutor or a hadoop admin who can teach me basics about -- Hadoop( Hdfs, MapReduce, Hive, Hue, Yarn, Spark, Kafka, Cassandra, Mongo, Linux, DBA, Java, Networking, Active Directory, TLS, Encryption) . I don't need very deep insights I just need outline and someone who can answer patiently all my questions. 13 Java, Linux, 大数据, Hadoop, Map Reduce Dec 14, 2017 Dec 14, 20175天 4时 $47
Hadoop real-time project explanation -- 2 I need a real-time Hadoop developer For project explanation 7 SQL, Hadoop, Map Reduce, Hive, HBase Dec 11, 2017 Dec 11, 20171天 9时 $203
Hadoop real-time project explanation I need a real-time Hadoop developer For project explanation 7 SQL, Hadoop, Map Reduce, Hive, HBase Dec 11, 2017 Dec 11, 20171天 9时 $765
hadoop, mapreduce machine learning expert needed i want to apply knn algorithm on the input files attached using hadoop, map reduce. 4 Java, 机器学习, Hadoop, Map Reduce Dec 10, 2017 Dec 10, 201711时 59分 $234
Video lecture course for Big Data Hadoop Video Course on Big Data Hadoop. It would be screen recording and voice over. Should cover the course using practical examples. The recording will be approx 10 hrs 11 大数据, Hadoop, Map Reduce, Hive, Spark Dec 9, 2017 Dec 9, 2017已经结束 $4163
Hadoop based wiki search engine Hi, I need a Hadoop expert to help create a search engine program for wikipedia data. You must use the wikipedia XML data and then format it, then create a map reduce job and a ranking algorithm. After the job is run, user must be presented with top 10 results. Please bid if you have good hadoop experience. Thanks 10 大数据, Hadoop, Map Reduce, Scala, Spark Dec 7, 2017 Dec 7, 2017已经结束 $7889
Use Hadoop and MapReduce to merge data By using Java, use [链接已删除,请登录查看] as your starting template to process music data, implement the Mappers to parse data from different data sets to generate intermediate outputs, which will then be further analyzed and aggregated by the Reducer to produce desired results. 18 Java, Hadoop, Map Reduce Dec 7, 2017 Dec 7, 2017已经结束 $1101
Query Performance improving using bucketing using Haddop and Hive Query performance improving in bucketing using map reduce or any algorithm with Hive, comparatively should show the implemantation in Hadoop , on any data set ....for example I wanted to create a single bucket for different different buckets to show that improved performance comparatively than the existing system 10 Java, 大数据, Hadoop, Map Reduce, Elasticsearch Dec 6, 2017 Dec 6, 2017已经结束 $824
Hadoop Architect interview Proxy Project Description I am looking for a male who is expertSkillset Grid , Hadoop Hive Service, Java EE As a Technology Architect, you will significantly contribute to identifying best-fit architectural solutions for one or more projects; develop design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. You will collaborate with so... 14 Java, Oracle, 大数据, Hadoop, Map Reduce Dec 6, 2017 Dec 6, 2017已经结束 $9592
Big data hadoop support I need the job support for my project on Big Data hadoop, spark,Nosql 7 Java, 大数据, Hadoop, Map Reduce, Elasticsearch Dec 5, 2017 Dec 5, 2017已经结束 $3124
data engineer • Architect and maintain our data Infrastructure on AWS, including: • Data Lake (Redshift) • Cluster computing resources (Apache Spark) • Distributed messaging and streaming platforms (Apache Kafka) • Distributed storage (S3) • Design and implement data applications on cluster computing and streaming engines • Design and implement data processing microservi... 13 Python, 数据挖掘, 大数据, Hadoop, Map Reduce Dec 3, 2017 Dec 3, 2017已经结束 $7819
Informatica dataquality Developer Profile source data and determine all source data and metadata characteristics; Design and execute a Data Quality Audit/Assessment; Design and execute the data quality mappings that will cleanse, de-duplicate, and otherwise prepare the project data Implement data quality processes including transliteration, parsing, analysis, standardization and enrichment at point of entry and batch modes; Deplo... 6 数据处理, 大数据, Hadoop, Map Reduce, 数据仓库 Dec 2, 2017 Dec 2, 2017已经结束 $3231
Video Course on Prractical Big Data Hadoop Video Course on Big Data Hadoop. It would be screen recording and voice over. Should cover the course using practical examples. The recording will be approx 10 hrs 2 大数据, Hadoop, Map Reduce, Scala, Spark Dec 1, 2017 Dec 1, 2017已经结束 $742
Code Deployment on AWS -- 2 code deployment on AWS Elastic Map Reduce . Code exists already only need to run with one minor modification . 10 programs need to be run by creating clusters on my AWS free tier account via team viewer. my friend developed code and is perfect but i added just two statements (if there is error due to this , you need to correct it in python). also, you need to place a minor code to get output in my... 7 Python, 亚马逊网络服务, Hadoop, Map Reduce Dec 1, 2017 Dec 1, 2017已经结束 $312
Hadoop dev with Aws and Spark Implementation:Proxy Project Description I am looking for a male who is expert in SQL, PL/SQL, Hadoop, Sqoop, Hive, Hbase, pig, Kafka along with Data Warehousing background. Good experience in Database Design , ETL and Frameworks. Good working knowledge on Map Reduce, HDFS and Spark, Need good communication skills and available to take phone interview for a contracting position in US time zone during working... 4 Java, J2EE, 大数据, Hadoop, Map Reduce Nov 30, 2017 Nov 30, 2017已经结束 $898
Hadoop development Hadoop, Big data development project 7 大数据, Hadoop, Map Reduce, Hive Nov 27, 2017 Nov 27, 2017已经结束 $12505
Hadoop developer/Spark/Scala developers a. Guide the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, application design and development, testing, and deployment. b. Provide technical and managerial leadership in a team that designs and develops path breaking large-scale cluster data processing systems. [链接已删除,请登录查看] in Big Data architecture, Hadoop stack includin... 2 大数据, Hadoop, Map Reduce, Scala, Spark Nov 20, 2017 Nov 20, 2017已经结束 $156593
EXPERT IN TECHNICAL WORKS JAVA, HADOOP, AWS, SCALA, PYTHON, ETC 17 Java, Python, 亚马逊网络服务, Hadoop, Map Reduce Nov 19, 2017 Nov 19, 2017已经结束 $227
Code Deployment on AWS code deployment on AWS Elastic Map Reduce . Code exists already only need to run with one minor modification . 10 programs need to be run by creating clusters on my AWS free tier account via team viewer. my friend developed code and is perfect but i added just two statements (if there is error due to this , you need to correct it in python). also, you need to place a minor code to get output in my... 3 Python, 亚马逊网络服务, Hadoop, Map Reduce Nov 16, 2017 今天已经结束 $164
Hadoop Spark/Scala Project Homework A) Using Hadoop hdfs & Spark-scala programming Source dataset: [链接已删除,请登录查看] download data for 1999,2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008 1) Download and combine all data for the years specified about 2) Data Cleanup: Find and remove /filter out outliers & bad data 3) Perform statistics analyis on the data: counts /averages /sums / min /max 3) Using spark/... 6 大数据, Hadoop, Map Reduce, Scala, Spark Nov 15, 2017 今天已经结束 $1304
mapreduce project segregating account holders with same pan number from different bank datasets and calculating their daily transaction in all bank accounts 2 Map Reduce Nov 7, 2017 Nov 7, 2017已经结束 $240
Python 一个连接的百度地图个性化设计 代码连接: 1,代码使用python框架进行开发; 2,平台需要中文和英文版本; 3,平台需要把英文版本的开发地图变为中文的; 4,把现有的功能集成到百度地图上面实现功能 5,把一个地址列表加到百度地图里面并且搜索框可以搜索到; 6 PHP, Python, Django, 软件构架, Map Reduce Oct 27, 2017 Oct 27, 2017已经结束 $3968
PMC scheduling Need to interact with clients, contractor and consultant to arrive at the MEP testing and commissioning witness scheduling 3 项目调度, Map Reduce Oct 22, 2017 Oct 22, 2017已经结束 $981
Hadoop Spark/Scala Expert Needed Are you familiar with Hadoop Spark/Scala and know Java? If yes, please bid and we can discuss in detail Please mention your experience in these areas 25 Java, 大数据, Hadoop, Map Reduce, Spark Oct 19, 2017 Oct 19, 2017已经结束 $1687
Install and implement instances of your chosen data storage and management systems. - open to bidding Install and implement and analyze instances of your chosen data storage and management systems. Contact me for more info 4 Java, NoSQL Couch 和 Mongo, 大数据, Hadoop, Map Reduce Oct 19, 2017 Oct 19, 2017已经结束 $1476
Hadoop components,MapReduce Programming,Big Data processing using Hadoop MapReduce framework you’ll install the QuickStart version of Cloudera’s Express distribution of Hadoop. You’ll also write your first MapReduce program 3 Java, 大数据, Hadoop, Map Reduce, Spark Oct 16, 2017 Oct 16, 2017已经结束 $531
REAL TIME PROJECT - INSURANCE DOMAIN : BIG DATA AND HADOOP TITLE : REAL TIME PROJECT - INSURANCE LANGUAGE : JAVA VM : CLOUDERA QUICKSTART VM 5.5 IDE : ECLIPSE IDE ABSTRACT : Analyze health reports across years for the US market and find the average of privately and public insured people from years 2001-2011. The Project was processed by MapReduce method and output achieved. 9 Java, Hadoop, Map Reduce, Hive, HBase Oct 9, 2017 Oct 9, 2017已经结束 $157
Video Training on Big Data Hadoop Video Training on Big Data Hadoop. It would be screen recording and voice over. The recording will be approx 10 hrs 5 大数据, Hadoop, Map Reduce, Hive, Spark Oct 8, 2017 Oct 8, 2017已经结束 $7288
I would like to hire a Spark Developer - 06/10/2017 14:22 EDT Project consist of technologies like spark with java, hadoop, mapr 13 Java, 大数据, Hadoop, Map Reduce Oct 6, 2017 Oct 6, 2017已经结束 $211
Predicting the best film of the year 2017 The project should predict the best film of the year 2017 by using sentiment analysis aalgorithm which is a supervised machine learning [链接已删除,请登录查看] have to use film based datasets and apply map reduce [链接已删除,请登录查看] project should be done in (Hadoop with Java) or (Hadoop with python) 6 Java, 算法, 机器学习, Hadoop, Map Reduce Oct 3, 2017 Oct 3, 2017已经结束 $258
Build a Website - 2D MAP -- 2 PLEASE DO NOT BID SPECULITIVELY WITHOUT FULLY READING AND UNDERSTANDING THE REQUIREMENTS. PLEASE BID WITH REALISTIC PRICE, I WILL NOT USE ANYONE WHO ASKS FOR MONEY HIGHER THAN BID PRICE I require a gaming website building, it should work on desktop, mobile and tablet but should primarily be designed for mobile/tablet. Exact details of the content and game functionality to be confirmed once a N... 14 网站设计, 平面设计, 地图学与地图, Map Reduce, 谷歌地图应用程序界面 Sep 24, 2017 Sep 24, 2017已经结束 $4781
Looking for a Hadoop Spark / Redshift Developer 1)Please provide one (small / medium ) use case of your Hadoop ETL work in detail. 2)f there are some X number of customers and they made some purchases. Can you write an SQL to find out the TOP 5 customers who made the most purchases. 3)What did you use Map Reduce for? What did you use PIG for ? What did you use Hive for ? where does the data gets transformed? / While performing transformations... 19 Hadoop, Map Reduce, 软件开发, Spark, Redshift软件 Sep 23, 2017 Sep 23, 2017已经结束 $445
US H1 B VISA DATA ANALYSIS I've done my engineering with a specialization in Electronics and Communication. As I am much interested in Big data Domain I gained a certification in it. Project is all about data analysis and tools required are Hive, Pig and Sqoop wherein HDFS is used for data storage and MapReduce framework is used for processing. 8 大数据, Hadoop, Map Reduce, Ubuntu, Hive Sep 14, 2017 Sep 14, 2017已经结束 $3708
Twitter Sentiment Anlaysis Do sentiment analysis on tweets and classify them using Naive Bayes clasifier using Map reduce. The topic of tweets is UK 2017 genral election held on 8th june 2017. The tweet Id's for the related tweets are available. 13 Java, Hadoop, Map Reduce Sep 4, 2017 Sep 4, 2017已经结束 $1495
Video Tutorial/ Training on Big Data Hadoop Video Tutorial on Big Data Hadoop. It would be screen recording and voice over. The recording will be approx 7 - 8 hrs 6 大数据, Hadoop, Map Reduce, Hive, HBase Aug 25, 2017 Aug 25, 2017已经结束 $937
I would like to hire a Hadoop Consultant Hadoop Administration for 100 hours (44T + 56L) in PG-DHPCSA, ACTS, Pune 3 Hadoop, Map Reduce, HBase, Cassandra Jul 24, 2017 Jul 24, 2017已经结束 $174
A map tool that creates KML files of routes between points provided in a KML with specific criteria as in description of Project Listed Skills as required are NOT REQUIRED they are just categories that might help freelancers find this Project. A map tool that creates multiple KML files of routes between custom set coordinate points on a map (provided as a KML). Any mapping platform can be used to achieve this: LeafletJS, Google Maps API, Mapbox, Bing Maps, HERE and more. The freelancer can pick which they prefer to achie... 9 Javascript, 地图学与地图, Map Reduce, 软件开发, 谷歌地图应用程序界面 Jul 15, 2017 Jul 15, 2017已经结束 -
Python SQL expert need someone with knowledge of Hadoop, map reduce, sql, python, data mining 15 Python, 软件构架, 大数据, Hadoop, Map Reduce Jul 10, 2017 Jul 10, 2017已经结束 $228
Showing 1 to 39 of 39 entries
« 1 »