Document clustering groups similar text documents together without using labels. Hierarchical clustering organizes these groups into a tree structure for easier browsing. Challenges include dealing with large amounts of data and creating meaningful cluster labels. Different clustering algorithms are used, including partitioning, agglomerative and divisive clustering, and frequent itemset-based clustering. The last algorithm is designed specifically for hierarchical document clustering.