The recent worldwide decline of honey bee colonies is a major ecological problem which also threatens pollinated crop production. Several interacting stressors such as environmental pressures and pathogens are suspected. Recently, the gut microbiota has emerged as a critical factor affecting bee health and fitness. We profiled the bacterial communities associated with the gut and whole body of worker bees to assess whether non-thriving colonies could be separated from thriving hives based on their microbial signature. The microbiota of thriving colonies was characterised by higher diversity and higher relative abundance of bacterial taxa involved in sugar degradation that were previously associated with healthy bees (e.g. Commensalibacter sp. and Bartonella apis). In contrast, the microbiota of non-thriving bees was depleted in health-associated species (e.g. Lactobacillus apis), and bacterial taxa associated with disease states (e.g. Gilliamella apicola) and pollen degradation (e.g. G. apicola and Bifidobacterium asteroides) were present in higher abundance compared to thriving colonies. Gut and whole-body microbiota shared a similar dominant core but their comparison showed differences in composition and relative abundance. More differences in taxon relative abundance between gut and whole body were observed in non-thriving bees, suggesting that microbiota associated with other bee organs might also be different. Thus, microbiota profiling could be used as a diagnostic tool in beekeeping practices to predict hive health and guide hive management.