Phytoplankton populations in the natural environment interact with each other. Despite rising global concern with Pseudo-nitzschia blooms, which can produce the potent neurotoxin domoic acid, we still do not fully understand how other phytoplankton genera respond to the presence of Pseudo-nitzschia. Here, we used a 4-year high-resolution imaging dataset for 9 commonly found phytoplankton genera in Narragansett Bay, alongside environmental data, to identify potential interactions between phytoplankton genera and their response to elevated Pseudo-nitzschia abundance. Our results indicate that Pseudo-nitzschia tends to bloom either concurrently with or right after other phytoplankton genera. Such bloom periods coincide with higher water temperatures and lower salinity. Pseudo-nitzschia image abundance tends to increase the most from March-May and peaks during May-Jun, whereas the image-derived biovolume and width of Pseudo-nitzschia chains increase the most during Jan-Feb. For most phytoplankton genera, their relationship with Pseudo-nitzschia abundance is noticeably different from their relationship with Pseudo-nitzschia image features. Despite the complexity in the phytoplankton community, our analysis suggests several ecological indicators that may be used to determine the risk of harmful algal blooms.