Alisher Navoiy nomidagi Toshkent
davlat o‘zbek tili va adabiyoti
universiteti
“KOMPYUTER LINGVISTIKASI:
MUAMMOLAR, YECHIM, ISTIQBOLLAR”
Xalqaro ilmiy-amaliy konferensiya
Vol. 1
№. 01 (2022)
http://compling.navoiy-uni.uz/
277
tomonidan yo‘l qo‘yiladigan xatoliklarga sabab bo‘lmoqda.
Shu bois leksik
birliklarni tartiblovchi dasturning lingvistik ta’minotini yaratish muhim ahamiyatga
ega hisoblanadi.
Foydalanilgan adabiyotlar:
[1] M.Abjalova Tahrir va tahlil dasturlarining lingvistik modullari
(PDF) Tahrir va
tahlil dasturlarining lingvistik modullari: monografiya linguistic modules of text
editing and analysis programs: monograph языковые модули программ
редактирования и анализа текста: Монография (researchgate.net)
[2] K.Brugmann. Einleitung und Lautlehre:
vergleichende Laut, Stammbildungs-
und Flexionslehre der indogermanischen Sprachen.
Walter de Gruyter, Berlin,
Leipzig. Bryant 2001
[3] Порохницкая,
Лидия Васильевна; государственный
лингвистический
университет. – Москва, 2004. – 195 с.
[4] Brinton 1891 — D. Brinton. The American race. A linguistic classification and
ethnographic description of the native tribes of North and South America. N. D. C.
Hodges, New York. Brown et al. 2013
[5] https://uz.wikipedia.org/
[6]
http://www.marifat.uz/
[7]
https://en.wikipedia.org/wiki/Word_order
[8]
Djumabayeva J. O‘zbek va ingliz tillarida leksik graduonimiya: Filol.fan.dokt.
... diss.avtoref. – Toshkent, 2016; va boshqalar.
[9]
.
https://www.geeksforgeeks.org/nlp-how-tokenizing-text-sentence-words-
works/
[10] https://www.thoughtvector.io/blog/subword-tokenization/ [7-charachter-level]: