名词
中文翻译:分词
同义词:
['tokenization', 'tokenizing']
例句:
-
1. The word-splitting algorithm is used to analyze the structure of text.
分词算法用于分析文本结构。
-
2. The programmer needs to split the long sentence into smaller words for better understanding.
程序员需要将长句子拆分成更小的单词以便更好地理解。
-
3. The linguist uses word-splitting techniques to improve the accuracy of their analysis.
语言学家使用分词技术来提高他们分析的准确性。