A corpus can be broken into units, which are calledĀ sentences. Sentences hold the meaning and context of the corpus, once we combine them together. Sentence formation takes place with the help of parts of speech. Every sentence is separated from other sentences by a delimiter, such as a period, which we canĀ make use of to break it up further. This is called sentence tokenization.