+ xccsRt^RIHt^RIHt^RIHt^RIHt^RIHt^RIt^RIt^RI t ^RI t ^RI t ^RI t ] P!R4t]!^4sRtRt^RItR tRt^RItR t^dt!R R 4t!R R 4tR tRRlt]R8Xd ]!4R#R# ]3d^RItR tLJ ]3dLUi;ii;i ]3dL^i;i)zZA module used by ibus-typing-booster to suggest words by using the hunspell dictonaries. )Dict)Tuple)List)Iterable)AnyNzibus-typing-boosterFTcsLaa]tRt^FtoRt/tRV3RlV3RllltRV3RlRlltV3RlRltV3RlR lt V3R lR lt V3R lR lt V3RlRlt V3RlRlt V3RlRltV3RlRltV3RlRlt]P$!RR7V3RlRl4tV3RltRtVtV;t#) Dictionaryz%A class to hold a hunspell dictionarycs,<V^8dQhRS[RS[RS[/#)clsnamereturn)rstrformat __classdict__"9/usr/share/ibus-typing-booster/engine/hunspell_suggest.py __annotate__Dictionary.__annotate__Qs"##S####c s<W3pW P9d0\SV` V4pW0PV&VPVR7VPV,#)zFCaching instances of this class and reuse previously created instancesr) _instancesZsuper__new__ _initialize)rrkeyZinstance __class__s&& rrZDictionary.__new__QsNk nn $ws+H"*NN3   d +~~c""rcs$<V^8dQhRS[RR/#)rrr N)r r rrrrZs###$#rc sX\^8d\PRV4WnVPP R4^,VnRVnRVn.Vn.Vn ^Vn RVn RVn RVn VPR8wdVP4R#R#)zInitialize a Dictionaryzname=%s_ZUTF-8NZNone) DEBUG_LEVELLOGGERdebugrsplitlanguagedic_pathencodingwords word_pairs max_word_len enchant_dictpyhunspell_objectvoikkoload_dictionary)selfr&&rrZDictionary._initializeZs ? LLD )  ,Q/   ! 13 !%(, 99   " rc<V^8dQhRR/#rr Nr rrrrksG2G2G2rc  s> \^8d\PR4\P!VP 4wVnVnVnVP'EdpVP\P9dYVPUu.uF<pV\P!V\PVP,R73NK> upVn VPF'p\VP\V44VnK) \^8d!\PRVP4VP P!R4^,R8XdWRVnRVnRVn\('g\P+R4R#\,P.!R4VnR#\6'd\8P:!4pVP=VP R 4VP?VP 4Vn\^8dHVP"e8\PR VP VP"P@4R#R#R#\J'dZVP 'dFVP PMR R4p\NPP!VP V4VnR#R#R#R#uupi \,P03d>p\P+RTP2P4T4RTnRp?R#Rp?ii;i \8PBPDdIp\PGR TP TP2P4T4RTnRp?R#Rp?i\HdIp\PGR TP TP2P4T4RTnRp?R#Rp?ii;i \NPRdIp\PRTP TP2P4T4RTnRp?R#Rp?i\HdIp\PRTP TP2P4T4RTnRp?R#Rp?ii;i)z^Load a hunspell dictionary and instantiate a enchant.Dict() or a hunspell.Hunspell() object. zload_dictionary() ... Zkeepzmax_word_len = %s rZfiNu7Language is “fi” but “import libvoikko” failed.zInit of voikko failed: %s: %szhunspell,nuspell,aspell,voikkoz%s: %rz)Error initializing enchant for %s: %s: %sz4Unexpected error initializing enchant for %s: %s: %sz.dicz.affz*Error initializing hunspell for %s: %s: %sz5Unexpected error initializing hunspell for %s: %s: %s)*rrritb_utilZ get_hunspell_dictionary_wordlistrr r!r"rACCENT_LANGUAGESremove_accentsr#Zmaxr$lenrr%r&r'IMPORT_LIBVOIKKO_SUCCESSFULZwarning libvoikkoZVoikkoZVoikkoExceptionr__name__IMPORT_ENCHANT_SUCCESSFULenchantZBrokerZ set_orderingZ request_dictZproviderZerrorsZDictNotFoundErrorZ exceptionZ ExceptionIMPORT_HUNSPELL_SUCCESSFULreplacehunspellZHunSpellZ HunSpellError)r)xwordZerrorZbrokerZaff_paths& rr(ZDictionary.load_dictionaryks ? LL2 3 @@K    :::}} 9 99"ZZ#(// 9 9$-- HJK'#  $'(9(93t9$E!#Q )4+<+<>yys#A&$.$(!)-&" 22NNQS'"+"2"24"8DK (( )##DII/OP-(.(;(;DII(FD%"Q4+<+<+H $dii1B1B1K1KM,I,+ ==00@2 )) MM85*1>+[ #("113'NN#B#(??#;#;UD"&DKK '~~77-$$C 5??#;#;UD)-D%% -$$N 5??#;#;UD)-D%% - --2LLD 5??#;#;UD.2D** 2LL% 5??#;#;UD.2D** 2stAK K;A.L3*&O.L032L++L03O+=N O+"O+#=O&&O+.R=Q RR=RRc&<V^8dQhRS[RS[/#rr<r r boolr rrrrs K Ks Kt Krc sVP'gR#VPP\P!RV44#)z Spellcheck a word using enchant :param word: The word to spellcheck :return: True if spelling is correct, False if not or unknown FNFC)r%Zcheck unicodedata normalizer)r<r*rspellcheck_enchantZDictionary.spellcheck_enchants9     &&{'<'r?r rrrrs + +# +$ +rc sVP'gR#VPP\P!RV4P VP R44#)z Spellcheck a word using pyhunspell :param word: The word to spellcheck :return: True if spelling is correct, False if not or unknown FrAr9)r&spellrBrCencoder!rDr*rspellcheck_pyhunspellZ Dictionary.spellcheck_pyhunspellsR%%%%%++  ! !% . 5 5 y *+ +rcr=r>r?r rrrrs K Kc Kd Krc sVP'gR#\VPP\P!RV444#)z Spellcheck a word using voikko :param word: The word to spellcheck :return: True if spelling is correct, False if not or unknown FrA)r'r@rFrBrCrDr*rspellcheck_voikkoZDictionary.spellcheck_voikkos7{{{DKK%%k&;&;E4&HIJJrcr=r>r?r rrrrsstrc sVP'dVPV4#VP'dVPV4#VP'd%\ VPP V44#R#)aY Spellcheck a word using enchant, pyhunspell, or voikko :param word: The word to spellcheck :return: True if spelling is correct, False if not or unknown >>> d = Dictionary('en_US') >>> d.spellcheck('winter') True >>> d.spellcheck('winxer') False >>> d = Dictionary('None') >>> d.spellcheck('winter') False >>> d.spellcheck('winxer') False F)r%rEr&rHr'r@rFrDr*r spellcheckZDictionary.spellchecksd*    **40 0  ! ! !--d3 3 ;;; ))$/0 0rcs <V^8dQhRS[/#rr )r@r rrrrs4rc svVP'g%VP'gVP'dR#R#)aD Returns wether this dictionary supports spellchecking or not :return: True if this dictionary spports spellchecking, False if not Examples: >>> d = Dictionary('en_US') >>> d.has_spellchecking() True >>> d = Dictionary('zh_CN') >>> d.has_spellchecking() False >>> d = Dictionary('None') >>> d.has_spellchecking() False TF)r%r&r'r)&rhas_spellcheckingZDictionary.has_spellcheckings)(     6 6 6$+++rc6<V^8dQhRS[RS[S[,/#r>r rr rrrrsstCyrc V'dVP'g.#VPP\P!RV44Uu.uF(p\P!\P V4NK* up#uupi)z Return spellchecking suggestions for word using enchant :param word: The word to return spellchecking suggestions for :return: List of spellchecking suggestions, possibly empty. rA)r%suggestrBrCr/NORMALIZATION_FORM_INTERNALr)r<r;&& rspellcheck_suggest_enchantZ%Dictionary.spellcheck_suggest_enchants{4,,,I    % %k&;&;E4&H I  J  ! !44a 9 J  .BcrOr>rPr rrrr%s#$s)rc s>V'dVP'g.#VPP\P!RV4P VP R44Uu.uF(p\P!\ PV4NK* up#uupi)z Return spellchecking suggestions for word using pyhunspell :param word: The word to return spellchecking suggestions for :return: List of spellchecking suggestions, possibly empty. rAr9)r&rRrBrCrGr!r/rSrTrUrspellcheck_suggest_pyhunspellZ(Dictionary.spellcheck_suggest_pyhunspell%s4111I  " " * *%%eT299MM9. /  /  ! !44a 9 /  s).BcrOr>rPr rrrr8scd3irc rQ)z Return spellchecking suggestions for word using voikko :param word: The word to return spellchecking suggestions for :return: List of spellchecking suggestions, possibly empty. rA)r'rRrBrCr/rSrTrUrspellcheck_suggest_voikkoZ$Dictionary.spellcheck_suggest_voikko8sv4;;;I KK   5 5eT B C  D  ! !44a 9 D  rW ZmaxsizecrOr>rPr rrrrVs  s tCy rc sVP'dVPV4#VP'dVPV4#VP'dVP V4#.#)u|Return spellchecking suggestions for word using enchant, pyhunspell or voikko :param word: The word to return spellchecking suggestions for :return: List of spellchecking suggestions, possibly empty. Results can be quite different depending on whether enchant or pyhunspell is used and in case of enchant whether hunspell, aspell, myspell, or ispell are used. So for the doctests, better don’t check the complete list of suggestions returned. Examples: >>> d = Dictionary('en_US') >>> 'Camel' in d.spellcheck_suggest('kamel') True >>> d.spellcheck_suggest('') [] >>> d = Dictionary('None') >>> d.spellcheck_suggest('kamel') [] )r%rVr&rXr'rYrDr*rspellcheck_suggestZDictionary.spellcheck_suggestUs]6    2248 8  ! ! !55d; ; ;;;11$7 7 rcsR<V^8dQh/S[S[S[S[3,S[3,;R&#)rr)rrrr r rrrrFs$U38_c)*/r) r r%r!rr$rr&r'r#r")Zen_US)r5 __module__ __qualname____firstlineno____doc__rrrr(rErHrIrJrNrVrXrY functools lru_cacher\Z__annotate_func____static_attributes____classdictcell__Z __classcell__)rr s@@rrrFs/.0J####"G2G2R K K + + K K:0(&:) * arrcsa]tRtRtoRtRV3RlRlltV3RlRltV3RlRltV3R lR ltV3R lR lt V3R lRlt RV3RlRllt ] P!RR7V3RlRl4tRtVtR#)HunspelliyzTA class to suggest completions or corrections using a list of Hunspell dictionaries c4<V^8dQhRS[S[,RR/#rdictionary_namesr N)rr r rrrHunspell.__annotate__}s!!#!!rcsv\\\P!R444s\^8d5V'd\PRV4M\PR4/Vn \V4Vn .Vn VP4R# \ \ 3d\^4sLi;i)ZIBUS_TYPING_BOOSTER_DEBUG_LEVELz'Hunspell.__init__(dictionary_names=%s) z'Hunspell.__init__(dictionary_names=()) N)intr osZgetenvrZ TypeErrorZ ValueErrorrr_suggest_cachelist_dictionary_names _dictionariesinit_dictionaries)r)rhr*r__init__ZHunspell.__init__}s !BII?@ACK ? >$& GH@B,01A,B/1  :& !a&K !s(BB87B8cr+r,r-r rrrrisHH4Hrc s^\^8dIVP'd"\PRVP4M\PR4VPP 4.VnVPF(pVP P\VR74K* R#)z-Initialize the hunspell dictionaries z1Hunspell.init_dictionaries() dictionary_names=%s z1Hunspell.init_dictionaries() dictionary_names=() rN) rrnrrrRZ cache_clearroappendr)r)Zdictionary_name& rrpZHunspell.init_dictionariess ?%%% H**, HJ   "#55O    % %jo&F G 6rcs0<V^8dQhRS[S[,/#rKrr r rrrris//d3i/rc s:\VPR,4#)zReturns a copy of the list of dictionary names. It is important to return a copy, we do not want to change the private member variable directly.:NNN)rmrnrLrMrget_dictionary_namesZHunspell.get_dictionary_namess D**1-..rcrfrgrtr rrrris66T#Y646rc sWP8wd\V4\VP48wdWnVP4MNWn.pVF:pVPF'pVPV8XgKVP V4K) K< W n\ ^8dL\PRV4VPF#p\PRVP4K% R#R#)zSets the list of dictionary names. If the new list of dictionary names differs from the existing one, re-initialize the dictionaries. zset_dictionary_names(%s): z%s N) rnZsetrprorrrrrr)r)rhZdictionaries_newr dictionary&& rset_dictionary_namesZHunspell.set_dictionary_namess 55 5#$D,B,B(CC)9&&&( *:&#% ,D&*&8&8 %??d2,33J?'9-&6" ? LL68H I"00  VZ__51 rcr=r input_phraser r?r rrrris66s6t6rc sRV9dR#RpRpVPF4pVP4'gKRpW4PV4,pK6 V'g V'dR#R#)u Checks if a string is likely to be spelled correctly checking multiple dictionaries :param input_phrase: A string to spellcheck :return: True if it is more likely to be spelled correctly, False if it is more likely to be spelled incorrectly. In detail this means: True: - If it is a correctly spelled word in at least one of the dictionaries supporting spellchecking - None of the dictionaries support spellchecking - Contains spaces, spellchecking cannot work else False. Examples: >>> h = Hunspell(['en_US', 'de_DE', 'ja_JP']) >>> h.spellcheck('Hello') True >>> h.spellcheck('Grüße') True >>> h.spellcheck('Gruße') False >>> h = Hunspell(['en_US', 'ja_JP']) >>> h.spellcheck('Grüße') False >>> h = Hunspell(['ja_JP']) >>> h.spellcheck('Grüße') True >>> h = Hunspell(['en_US', 'None']) >>> h.spellcheck('Grüße') False >>> h = Hunspell(['None']) >>> h.spellcheck('Grüße') True Z TF)rorNrJ)r)rzZ$spellchecking_dictionaries_availablespellcheck_totalrvrwrrJZHunspell.spellcheckscX , /4, ,,J++--7;4 $9$9,$GG - $HrcrOryrPr rrrris#$s)rc s.pVP4'g.#VPF7pVPV4'gKVPVP4K9 V#)u Returns a list of dictionaries where input_phrase can be found :param input_phrase: The word to be spellchecked :return: A list of dictionary names which accept input phrase as a valid word. Examples: >>> h = Hunspell(['en_US', 'None', 'it_IT', 'fr_FR']) >>> h.spellcheck_match_list('arrive') ['en_US', 'fr_FR'] >>> h.spellcheck_match_list('arrivé') ['fr_FR'] >>> h.spellcheck_match_list('ragazzo') ['it_IT'] >>> h.spellcheck_match_list(' ') [] )ZstriprorJrrr)r)rzZ match_listrvs&& rspellcheck_match_listZHunspell.spellcheck_match_listsX( !!##I,,J$$\22!!*//2-rcsF<V^8dQhRS[S[,RS[S[,/#)rr"r )rr rr rrrris'A(A((3-A(cA(rc sV'g.#VFpV'dK .u# .pVPFJpRpVFpWTPV4,pK V'gK/VPVP4KL \ V4#)u Checks whether there is at least one dictionary where all words in the input list spellcheck as True. :param words: A list or tuple of words to spellcheck :return: - '' if at least one input word is empty - name of a dictionary where all words in the input list spellcheck as True, if there is no such dictionary, return ''. Examples: >>> h = Hunspell(['en_US', 'fr_FR']) All 3 words spellcheck True in the French dictionary: >>> h.spellcheck_single_dictionary(('Je', 'suis', 'arrivé')) ['fr_FR'] Not a correct French sentence but all 3 words spellcheck True in the French dictionary: >>> h.spellcheck_single_dictionary(('Je', 'suis', 'arrive')) ['fr_FR'] All words spellcheck as True in both the English and the French dictionary: >>> h.spellcheck_single_dictionary(('arrive', 'arrive', 'arrive')) ['en_US', 'fr_FR'] Not all 3 words spellcheck True in the French dictionary and not all 3 words spellcheck True in the English dictionary either: >>> h.spellcheck_single_dictionary(('Je', 'suis', 'arrived')) [] All 3 words spellcheck True in the English dictionary: >>> h.spellcheck_single_dictionary(('I', 'have', 'arrived')) ['en_US'] Unfortunately these 3 words spellcheck True in the French dictionary ('have' is a form of the verb 'haver', 'I' is the name of the letter): >>> h.spellcheck_single_dictionary(('I', 'have', 'arrivé')) ['fr_FR'] If the input contains empty words the result is '': >>> h.spellcheck_single_dictionary(('I', 'have', '')) [] T)rorJrrrsorted)r)r"r<rhrvr{s&& rspellcheck_single_dictionaryZ%Hunspell.spellcheck_single_dictionarysjID4 ,,J#  $9$9$$??  '' 8 - &''rrZr[csL<V^8dQhRS[RS[S[S[S[3,,/#ry)r rrrjr rrrrigs,h"h"Ch"DsCx,Ah"rc  s\^8d(\PRRVPR4/4V'dRV9d.#\P !\ PV4p/pVPEFpVPp/W$&VP'gK(VP'd8\ P!V\ PVP,R7p\V4VP 8:dVP'dYXP#4pVPF7wrxVP#4P%V4'gK,^W$,V&K9 MUVP#4pVPF5pVP#4P%V4'gK*^W$,V&K7 \V4^8gEK]VP'V4'd ^W$,V&\)W$,4R,U U u/uF7p VP+V 4Fp V P%V 4'gKV ^bK! K9 p p p W$,P-V 4RVP+V44p \/V 4FwrWV,9gKVP'dJ\ P!V \ PVP,R7X8Xd^W$,V &KoV ^,)W$,V &K EK \ P0!VP34!p\)VP54RR 7^\6pV#uup p i) uReturn completions or corrections for the input phrase :param input_phrase: A string to find completions or corrections for Returns a list of tuples of the form (, ) can have these values: 0: This is a completion, i.e. input_phrase matches the beginning of (accent insensitive match) negative number: This is a spell checking correction Examples: (Attention, the return values are in internal normalization form ('NFD')) >>> h = Hunspell(['de_DE', 'cs_CZ']) >>> h.suggest('Geschwindigkeitsubertre')[0] ('Geschwindigkeitsübertretungsverfahren', 0) >>> h.suggest('Geschwindigkeitsübertretungsverfahren')[0] ('Geschwindigkeitsübertretungsverfahren', 0) >>> h.suggest('Glühwürmchen')[0] ('Glühwürmchen', 0) >>> h.suggest('Alpengluhen')[0] ('Alpenglühen', 0) >>> h.suggest('filosofictejs')[0] ('filosofičtější', 0) >>> h.suggest('filosofičtější')[0] ('filosofičtější', 0) >>> h.suggest('filosofičtějš')[0] ('filosofičtější', 0) >>> h = Hunspell(['it_IT']) >>> h.suggest('principianti') [('principianti', 0), ('principiati', -2), ('principiante', -3), ('principiarti', -4), ('principiasti', -5)] >>> h = Hunspell(['es_ES']) >>> h.suggest('teneis') [('tenéis', 0), ('teneos', -2), ('tenes', -3), ('tenis', -4), ('tienes', -5), ('te neis', -6), ('te-neis', -7)] >>> h.suggest('tenéis')[0] ('tenéis', 0) >>> h = Hunspell(['en_US']) >>> ('Camelot', 0) in h.suggest('camel') # Should work with aspell and hunspell True >>> h = Hunspell(['fr_FR']) >>> h.suggest('differemmen') [('différemment', 0)] >>> h = Hunspell(['None']) >>> h.suggest('camel') [] >>> h = Hunspell(['None', 'en_US']) >>> ('Camelot', 0) in h.suggest('camel') # Should work with aspell and hunspell True >>> h = Hunspell(['en_US']) >>> all((x, 0) in h.suggest('tree') for x in ('trees', 'treed')) True For benchmarking: >>> result = [h.suggest(c) for c in 'abcdefghijklmnopqrstuvwxyz'] >>> result = [h.suggest(word) for word in ('infl', 'mess', 'tree', 'temp', 'wood', 'gard', 'came', 'wind', 'wate', 'succ', 'dict', 'load', 'enco', 'spell', 'word', 'auto', 'mode', 'bicy', 'moun', 'batt', 'tabl', 'star', 'moon', 'univ')] z'Hunspell.suggest() input_phrase=%(ip)s ZiprZ/r.:iiNc3sl"TF*p\P!\PV4xK, R#5i)N)rBrCr/rS)Z.0r;rsrZ Z#Hunspell.suggest..s=)D$--$@@!EEDs24csJV^,)\V^,4V^,3#)i)r2)r;rMrZZ"Hunspell.suggest.. s"A$AaD !r)r)rrrrGrBrCr/rSrorr"r#r1r0rr2r$ZcasefoldZ startswithrJr}r\ZupdateZ enumerateZmerge_dicts_maxZvaluesZitems MAX_WORDS)r)rzZsuggested_wordsrvrZinput_phrase_no_accentsZqueryr<ZstrippedZ suggestionr;Zsuffixed_suggestionsZextra_suggestionsZindexZsuggested_words_totalZsorted_suggestionss&& rrRZHunspell.suggestfsZ ? LL:|**734 6sl2I",,  0 0,@ 68,,J??D$&O !(((.6.E.E$%66z7J7JK/M+ |$ (?(??!,,, 7 @ @ B.8.C.CND'002==eDD>? 5d ;/D!- 5 5 7$.$4$4D#}}99%@@>? 5d ;%5|$)!,,\::?@-l; +11F*G*L,*LJ!+!>!>z!JA<< 31!J*L), $)001EF)#55lC )% .77H-I)%T-BB * 5 5 5 ( 7 7$.)1)B)B(2(;(;*=!>$; !; EF 5j AFKaiL 5j A.Jc-z!) 8 8  # # %!'# ! ' ' )  "!E,s -M M)rornrlN)r-)r5r]r^r_r`rqrprurxrJr|r~rarbrRrcrd)r s@rrereysw!!&HH //66666p8A(A(`)h"*h"rrecsV^8dQhRR/#r,r-)r s"rrrs%%d%rcs\P!\PR7p\P!R4pVP V4\ P\P4\ PV4\'d)^RI p^RI pVP4pVP4^RIpVP!4wrg\'dgXP#4XP%V4pVP'4VP)R4VP+R^4VP+R^4\ P-R\.P0P344\P4!V4R#)up Used for testing and profiling. “python3 hunspell_suggest.py” runs some tests and prints profiling data. )ZstreamzP%(asctime)s %(filename)s line %(lineno)d %(funcName)s %(levelname)s: %(message)sNZ cumulativer:r7z(itb_util.remove_accents() cache info: %s)loggingZ StreamHandlersysZstderrZ FormatterZ setFormatterrZsetLevelZDEBUGZ addHandler BENCHMARKcProfilepstatsZProfileZenabledoctestZtestmodZdisableZStatsZ strip_dirsZ sort_statsZ print_statsZinfor/r1Z cache_infoZexit) Z log_handlerZ log_formatterrrZprofilerZfailedZ _attemptedZstatss rmainrs''szz:K%% M]+ OOGMM" k"y""$"??,Vy W%  & *b) )R( KK:''2246HHVrZ__main__)r`ZtypingrrrrrrkrrBrarr/Z getLoggerrrjrr6r8r7Z ImportErrorr:r3r4rrrerrr5r-rrrs*     0 1!f !"  $$ "&  ppf V"V"p  %N zFW ~  %)" >     ~  s<B!B;B8 B((B40B83B44B8;CC