Current theoretical frameworks suggest that human behaviors are based on strong and complex interactions between cognitive processes such as those underlying language and memory functions in normal and neurological populations. We were interested in assessing the dynamic cerebral substrate of such interaction between language and declarative memory, as the composite function, in healthy controls (HC, N = 19) and patients with temporal lobe epilepsy (TLE, N = 16). Our assumption was that the language and declarative memory integration is based on a language-and-memory network (LMN) that is dynamic and reconfigures according to task demands and brain status. Therefore, we explored two types of LMN dynamics, a state reconfiguration (intrinsic restingstate compared to extrinsic state assessed with a sentence recall task) and a reorganization of state reconfiguration (TLE compared to HC). The dynamics was evaluated in terms of segregation (community or module detection) and integration (connector hubs). In HC, the level of segregation was the same in both states and the mechanism of LMN state reconfiguration was shown through module change of key language and declarative memory regions with integrative roles. In TLE patients, the reorganization of LMN state reconfiguration was reflected in segregation increase and extrinsic modules that were based on shorter-distance connections. While lateral and mesial temporal regions enabled state reconfiguration in HC, these regions showed reduced flexibility in TLE. We discuss our results in a connectomic perspective and propose a dynamic model of language and declarative memory functioning. We claim that complex and interactive cognitive functions, such as language and declarative memory, should be investigated dynamically, considering the interaction between cognitive networks.