The Key Technologies of Collecting Tibetan Websites

Abstract

Tibetan websites are important for studying the Tibetan language and Tibetan culture. The domain names and character encodings of Tibetan websites are complex. Three key technologies of collecting Tibetan websites are discussed in this paper. Firstly, using high frequency syllables in different Tibetan character encoding to searcher the web pages may be in Tibetan as many as possible. Then, using Tibetan syllable dot and the properties of HTML to judge the language of web pages is in Tibetan or not. Thirdly, according the relationships between the URL of Tibetan web page and the URL of Tibetan website, the URLs of Tibetan websites are gotten. About 100 Tibetan websites in three Tibetan character encodings (Unicode, BZD and Tongyuan) are collected by these methods. These key technologies are also useful for collecting websites in other minority language.