It has been argued that lexical access in bilinguals is language nonselective. However, little is known about how the input modality (spoken or written) affects cross-language activation during listening and reading. The current study characterizes the nature of within- and cross-language competition for spoken and written words in adults who are bilingual and biliterate in Spanish and English. Using a recently developed cross-modality version of the Visual World Paradigm, we found that competition differs for spoken and written words. For spoken words, the auditory stimulus unfolds overtime giving an additional boost to within- and cross-language competition. Conversely, written words can be seen at once, and thus, incremental processing is less of a factor, resulting in less competition within a language and no competition across languages. The findings show that word recognition is fundamentally language nonselective but can behave in selective ways depending on the modality of the input and language experience.