Impacts of habitat loss and fragmentation on specialist herbivores have been rarely addressed. Here we examine the structure of plant and galling insect assemblages in a fragmented landscape of the Atlantic forest to verify a potential impoverishment of these assemblages mediated by edge effects. Saplings and galling insects were recorded once within a 0.1-ha area at habitat level, covering forest interior stands, forest edges, and small fragments. A total of 1,769 saplings from 219 tree species were recorded across all three habitats, with differences in terms of sapling abundance and species richness. Additionally, edge-affected habitats exhibited reduced richness of both host-plant and galling insects at plot and habitat spatial scale. Attack levels also differed among forest types at habitat spatial scale (21.1% of attacked stems in forest interior, 12.4% in small fragments but only 8.5% in forest edges). Plot ordination resulted in three clearly segregated clusters: one formed by forest interior, one by small fragments, and another formed by edge plots. Finally, the indicator species analysis identified seven and one indicator plant species in forest interior and edge-affected habitats, respectively. Consequently, edge effects lead to formation of distinct taxonomic groups and also an impoverished assemblage of plants and galling insects at multiple spatial scales. The results of the present study indicate that fragmentation-related changes in plant assemblages can have a cascade effects on specialist herbivores. Accordingly, hyperfragmented landscapes may not be able to retain an expressive portion of tropical biodiversity.