U AT^c@sldZdZddlZddlZddlmZddlmZddlm Z Gdd d e Z Gd d d e Z ia d d ZdS)aA bottom-up tree matching algorithm implementation meant to speed up 2to3's matching process. After the tree patterns are reduced to their rarest linear path, a linear Aho-Corasick automaton is created. The linear automaton traverses the linear paths from the leaves to the root of the AST and returns a set of nodes for further matching. This reduces significantly the number of candidate nodes.z+George Boutsioukis N) defaultdict)pytree) reduce_treec@s eZdZdZeZddZdS)BMNodez?Class for a node of the Aho-Corasick automaton used in matchingcCs"i|_g|_ttj|_d|_dS)N)transition_tablefixersZnextrcountidcontentselfr+/usr/lib64/python3.8/lib2to3/btm_matcher.py__init__s zBMNode.__init__N)__name__ __module__ __qualname____doc__ itertoolsr rrrrrrsrc@s8eZdZdZddZddZddZdd Zd d Zd S) BottomMatcherzgThe main matcher class. After instantiating the patterns should be added using the add_fixer methodcCs0t|_t|_|jg|_g|_td|_dS)NZRefactoringTool) ZsetZmatchrrootZnodesrloggingZ getLoggerZloggerr rrrrs  zBottomMatcher.__init__cCsH|j|t|j}|}|j||jd}|D]}|j|q2dS)zReduces a fixer's pattern tree to a linear path and adds it to the matcher(a common Aho-Corasick automaton). The fixer is appended on the matching states and called when they are reachedstartN)rappendrZ pattern_treeZget_linear_subpatternaddr)r fixerZtreeZlinear match_nodesZ match_noderrr add_fixer%s   zBottomMatcher.add_fixerc Cs|s |gSt|dtr`g}|dD]6}|j||d}|D]}|||dd|q:q$|S|d|jkrt}||j|d<n|j|d}|ddr|j|dd|d}n|g}|SdS)z5Recursively adds a linear pattern to the AC automatonrrrN) isinstanceZtuplerZextendrr)r ZpatternrrZ alternativeZ end_nodesZendZ next_noderrrr1s"  zBottomMatcher.addc Cs|j}tt}|D]}|}|rd|_|jD]$}t|tjr*|jdkr*d|_qPq*|j dkrb|j}n|j }||j kr|j |}|j D]}|| |qnH|j}|j dk r|j jrq||j kr|j |}|j D]}|| |q|j }qq|S)auThe main interface with the bottom matcher. The tree is traversed from the bottom using the constructed automaton. Nodes are only checked once as the tree is retraversed. When the automaton fails, we give it one more shot(in case the above tree matches as a whole with the rejected leaf), then we break for the next leaf. There is the special case of multiple arguments(see code comments) where we recheck the nodes Args: The leaves of the AST tree to be matched Returns: A dictionary of node matches with fixers as the keys Tz;FrN)rrZlistZ was_checkedZchildrenr rZLeafZvaluetyperrrZparent) r ZleavesZcurrent_ac_nodeZresultsZleafZcurrent_ast_nodeZchildZ node_tokenrrrrrunSs8          zBottomMatcher.runcs*tdfdd|jtddS)z %d [label=%s] //%sr)rZkeysprintr type_reprZstrrr )ZnodeZ subnode_keyZsubnode print_noderrr&s  z*BottomMatcher.print_ac..print_nodeZ}N)r#rr rr%rprint_acs  zBottomMatcher.print_acN) rrrrrrrr"r'rrrrrs  "8rcCsDts8ddlm}|jD]\}}t|tkr|t|<qt||S)Nr)python_symbols) _type_reprsZpygramr(Z__dict__Zitemsr!ZintZ setdefault)Ztype_numr(ZnameZvalrrrr$s   r$)rZ __author__rrZ collectionsrrrZ btm_utilsrZobjectrrr)r$rrrrZs