At Twitter, our on premise data centers contain hundreds of thousands of hardware servers and millions of server hardware components.

Twitter Engineering

Twitter faced challenges in kerberizing their Hadoop clusters, but they were able to enforce strong Authentication, Authorization, and Accountability for Hadoop data access by making code changes, developing keytab generation and distribution services, and implementing delegation token renewal. They took a multi-pronged approach to kerberizing their clusters one at a time, with minimal disruption to customer use cases.

Kerberizing Hadoop Clusters at Twitter

Constraints for Kerberizing Hadoop @ Twitter