What Does Lexeme Mean?
A lexeme is a sequence of alphanumeric characters in a token. The term is used in both the study of language and in the lexical analysis of computer program compilation. In the context of computer programming, lexemes are part of the input stream from which tokens are identified. An invalid or illegal token produces an error. A lexeme is one of the building blocks of language.
Techopedia Explains Lexeme
A lexeme is a basic unit of meaning. Lexemes are the headwords in dictionaries. The lexeme “play,” for example, can take many forms, such as playing, plays, played. A lexicon consists of lexemes.
Lexemes also play an important part in computer programming languages. However, the precision required in computer languages can be much more stringent. One stray character or misplaced symbol can stop an entire operation. During program compilation, lexical analysis is the computer’s attempt to make sense of the strings of characters in the input stream.
Each lexeme is analyzed for its usefulness. Particular patterns of alphanumeric strings make up what the computer recognizes as tokens. These tokens may be identifiers, keywords, operators, special symbols or constants. Valid tokens are used to form expressions that are part of the instructions of a computer program. The lexeme “Div” might be recognized as an identifier token. The computer may see “*” as a multiplier and “2” as a number.
Proper syntax is essential to good programming. Whereas in human speech one may be able to get by with slang, poor grammar or mispronunciation, computer language is generally more demanding.
