+
2iyL c sX R t ^ RIHt RtR.t^ RIHt ^ RIt^ RIH t H
t
H t H t H
t
HtHtHtHtHtHt ^ RIHtHtHtHtHtHt ^ RIH t H t ^ R I H t H t H!t!H"t" ^ R
I#H$t$ ]' d ^ R I%H&t& ^ R IH't' ^ R
I(H)t)H*t*H+t+ Rt,]
] ]-]-3, ]-]-.R3, t. ! R R]] 4 t/ ! R R]!4 t0R# )zCUse the HTMLParser library to parse HTML files that aren't too bad.) annotationsZMITHTMLParserTreeBuilder)
HTMLParserN) AnyCallablecastDictIterableListOptional
TYPE_CHECKINGTupleTypeUnion)
AttributeDictCDataComment DeclarationDoctypeProcessingInstruction)EntitySubstitution
UnicodeDammit)DetectsXMLParsedAsHTMLHTMLHTMLTreeBuilderSTRICTParserRejectedMarkup)
BeautifulSoup)NavigableString) _Encoding
_Encodings
_RawMarkupz html.parserc sR ] tR t^>t$ RtR]R& RtR]R& R]/R R lltR ]R& R
]R & R ]R
& R R ltR R lt R*R R llt
R*R R llt R R lt ]
P ! R4 t]
P ! R4 t]R R l4 tR R ltR R ltR R! ltR" R# ltR$ R% ltR& R' ltR(tR)# )+BeautifulSoupHTMLParserZreplacestrREPLACEZignoreIGNOREon_duplicate_attributec s( V ^8 d QhRRRRRRRR/# ) soupr argsr r% &Union[str, _DuplicateAttributeHandler]kwargs Zformat "
r1 c
sN V P WRR7 V P V4 R# )zmHandle an incoming empty-element tag.
html.parser only calls this method when the markup looks like
.
F)handle_empty_elementN)handle_starttag
handle_endtag)r7 r? r@ &&&r. handle_startendtagZ*BeautifulSoupHTMLParser.handle_startendtag s%
Se D 3 r1 c s( V ^8 d QhRRRRRRRR/# ) r& r? r" r@ rA rB boolr: r; r+ r, r- r. r/ r0 s2 <, <,
<, /<, # <,
<,r1 c
s V P 4 pV Fg w rVVf RpWT9 dS V P pWpP 8X d K/ VRV P 39 d WdV& KH \ \
V4 pV! WEV4 Kc WdV& Ki V P P P ' d V P 4 w rMR;rV P P VRRWHV R7 p
V
eI V
P ' d7 V' d/ V P VRR7 V P P V4 V P f V P! V4 R# R# )zHandle an opening tag, e.g. ''
:param handle_empty_element: True if this tag is known to be
an empty-element tag (i.e. there is not expected to be any
closing tag).
N )
sourceline sourceposF)check_already_closed)r4 r% r$ r# r _DuplicateAttributeHandlerr' r3 Zstore_line_numbersZgetposrC Zis_empty_elementrD r6 appendZ_root_tag_nameZ_root_tag_encountered) r7 r? r@ rB Z attr_dictZkeyvalueZon_duperI rJ ZtagObjs &&&& r. rC Z'BeautifulSoupHTMLParser.handle_starttag s4 $(#<#<#> JC } 55kk) t|| 44%*cN "#=w GGIE2!&#% , 99 / / /$(KKM !J %) )J** tY +
&"9"9"9>R
s ?
- - 4 4S 9 & & &s + 'r1 c r> )r& r? r" rK rG r: r; r+ r, r- r. r/ r0 s! ) ) )D )D )r1 c
s V' d. WP 9 d V P P V4 R# V P P V4 R# )zHandle a closing tag, e.g. ''
:param tag: A tag name.
:param check_already_closed: True if this tag is expected to
be the closing portion of an empty-element tag,
e.g. ''.
N)r6 Zremover' rD )r7 r? rK rE r. rD Z%BeautifulSoupHTMLParser.handle_endtag s: C+L+L$L
- - 4 4S 9 II # #C (r1 c r8 r& datar" r: r; r+ r, r- r. r/ r0 s $ $ $ $r1 c
s< V P P V4 R# )z4Handle some textual data that shows up between tags.N)r' handle_datar7 rP r< r. rQ Z#BeautifulSoupHTMLParser.handle_data s d#r1 z
^([0-9]+)(.*)z^([0-9a-f]+)(.*)c r8 )r& namer" r: zTuple[str, bool, str]r+ r, r- r. r/ r0 s 4; 4;3 4;CX 4;r1 c
s RpRpRp^
pV P pVP R4 ' g VP R4 ' d VR, p^pV P pRp \ W4 pVf RpTpM\ P ! V4 w r#W#V3# \ dQ TP T4 pTe9 \ TP
4 ^ , T4 pTP
4 ^, p Li ; i)aX Convert a numeric character reference into an actual character.
:param name: The number of the character reference, as
obtained by html.parser
:return: A 3-tuple (dereferenced, replacement_added,
extra_data). `dereferenced` is the dereferenced character
reference, or the empty string if there was no
reference. `replacement_added` is True if the reference
could only be dereferenced by replacing content with U+FFFD
REPLACEMENT CHARACTER. `extra_data` is a portion of data
following the character reference, which was deemed to be
normal data and not part of the reference at all.
rH FZxZX:i NNN) &_DECIMAL_REFERENCE_WITH_FOLLOWING_DATA
startswith"_HEX_REFERENCE_WITH_FOLLOWING_DATAZintZ
ValueErrorZsearchZgroupsr Znumeric_character_reference) clsrS dereferencedreplacement_added
extra_dataZbaseZregZ real_nameZmatchs && r. (_dereference_numeric_character_referenceZ@BeautifulSoupHTMLParser._dereference_numeric_character_reference s !&
88 ??3 4??3#7#78DD88C"& /DI$ L J.;.W.WXa.b +L
::- / JJt$E q 14 8 "\\^A .
/s B
AC('C(c r8 r& rS r" r: r; r+ r, r- r. r/ r0 s
)
)3
)4
)r1 c
s V P V4 w r#pV' d RV P n Ve V P V4 Ve V P V4 R# R# )zHandle a numeric character reference by converting it to the
corresponding Unicode character and treating it as textual
data.
:param name: Character number, possibly in hexadecimal.
TN)r[ r' contains_replacement_charactersrQ )r7 rS rX rY rZ s && r. handle_charrefZ&BeautifulSoupHTMLParser.handle_charref sV 7;6c6cdh6i3 8 '??CCDI D 4 s GS FC ( JQ (. CB"++
,
<,|)$$ .0ZZ-H*)+4F)G&4; 4;l
) &##
1 1r1 r! c s a ] tR tRt$ RtRtR]R& RtR]R& ]t R]R & ] ]
] .t R
]R & R ]R
& Rt
R]R& RR V 3R llltRR R llt]3R R lltRtV ;t# )r il zA Beautiful soup `bs4.builder.TreeBuilder` that uses the
:py:class:`html.parser.HTMLParser` parser, found in the Python
standard library.
FrG is_xmlT picklabler" NAMEz
Iterable[str]featuresz$Tuple[Iterable[Any], Dict[str, Any]] parser_argsTRACKS_LINE_NUMBERSc r> )r& rr zOptional[Iterable[Any]]
parser_kwargszOptional[Dict[str, Any]]r* r r+ r, r- r. r/ "HTMLParserTreeBuilder.__annotate__} s( 8 8, 8 0 8 8r1 c
s < \ 4 pR F pWS9 g K VP V4 pWdV& K" \ \ V ` ! R/ VB T;' g . pT;' g / pVP V4 RVR& W3V n R# )aB Constructor.
:param parser_args: Positional arguments to pass into
the BeautifulSoupHTMLParser constructor, once it's
invoked.
:param parser_kwargs: Keyword arguments to pass into
the BeautifulSoupHTMLParser constructor, once it's
invoked.
:param kwargs: Keyword arguments for the superclass constructor.
FZconvert_charrefsN)r% r+ )ZdictZpopZsuperr r5 Zupdaterr )r7 rr rt r* Zextra_parser_kwargsZargrN __class__s &&&, r. r5 Z HTMLParserTreeBuilder.__init__} s $ #f.C}
3+0C( / #T3=f=!''R %++
01,1
() '7r1 c
s, V ^8 d QhRRRRRRRRRR /# )
r& markupr user_specified_encodingzOptional[_Encoding]document_declared_encodingexclude_encodingszOptional[_Encodings]r: zDIterable[Tuple[str, Optional[_Encoding], Optional[_Encoding], bool]]r+ r, r- r. r/ ru sD F FF "5F %8 F
0 F
N
Fr1 c #
sl " \ V\ 4 ' d VRRR3x R# . pV' d VP V4 . pV' d VP V4 \ VVVRVR7 pVP f \ R4 hVP VP VP VP 3x R# 5i)a Run any preliminary steps necessary to make incoming markup
acceptable to the parser.
:param markup: Some markup -- probably a bytestring.
:param user_specified_encoding: The user asked to try this encoding.
:param document_declared_encoding: The markup itself claims to be
in this encoding.
:param exclude_encodings: The user asked _not_ to try any of
these encodings.
:yield: A series of 4-tuples: (markup, encoding, declared encoding,
has undergone character replacement)
Each 4-tuple represents a strategy for parsing the document.
This TreeBuilder uses Unicode, Dammit to convert the markup
into Unicode, so the ``markup`` element of the tuple will
always be a string.
NFT)known_definite_encodingsuser_encodingsZis_htmlrz zPCould not convert input to Unicode, and html.parser will not accept bytestrings.)
isinstancer" rM r Zunicode_markupr Zoriginal_encodingZdeclared_html_encodingr] )r7 rw rx ry rz r{ r| Zdammits &&&&& r. prepare_markupZ$HTMLParserTreeBuilder.prepare_markup s 2 fc " "4u- - 57 "
% + +,C D*, %
! !"< = %=) /
( 'b
%%((--66
s *B4B4A,B4c r> )r& rw r
_parser_classz type[BeautifulSoupHTMLParser]r: r; r+ r, r- r. r/ ru s# 1 1: 15R 1pt 1r1 c
s, V P w r4\ V\ 4 ' g Q hV P f Q hV! V P .VO5/ VB p VP V4 VP 4 . Tn R# \ d p\ T4 hRp?ii ; i)z
:param markup: The markup to feed into the parser.
:param _parser_class: An HTMLParser subclass to use. This is only intended for use in unit tests.
N) rr r} r" r' feedZcloseZAssertionErrorr r6 )r7 rw r r( r* ZparserZes &&& r. r ZHTMLParserTreeBuilder.feed s
'' &#&&&&
yy$$$ tyy:4:6: * KK LLN /1+ * 'q) ) *s !A8 8 B BB)rr )NN)NNN)rg rh ri rj __doc__rn rk ro
HTMLPARSERrp r r rq rs r5 r~ r! r rm Z
__classcell__)rv s @r. r r l sn FDItD# #T6 2Hm255 !%$ 8 8r s I " # 9 0!+
%tCH~sC&@$&F G k1j*@ k1\ T1O T1r1