[Python] What is sharding in machine learning and how to do sharding in Tensorflow?

What is sharding in the context of machine learning specifically ( a more generic antic question is asked here ) and how is it implemented in Tensorflow ?

What is referred to as sharding, why do we need sharding altogether, when speaking about the data pipeline in machine learning ?

Continue reading...