Home About

© 2021. All rights reserved.

braindump ... cause thread-dumps are not enough ;)

Testing MR jobs

07 Nov 2014

Some links with useful information regarding MR job testing:

Unit testing framework for mappers and reducers
Official guide how to develop unit tests for new hadoop code
Docs for MiniCluster
Guide how to do unit tests on Hadoop
Local mode - local job runner docs
Advice from CloudEra (doesn’t add anything really novel)

Related Posts

Model stores in ML platforms 30 Mar 2021
Feature stores from Data Engineering perspective 30 Mar 2021
Sales Force Marketing Cloud REST API upload errors 23 Mar 2021