U AT^c @sdZddlZddlZddlZddlZddlZddlZz ddlZWnek rXdZ YnXdZ ddl m Z ddlm Z ddd d d d d dgZdZGdddeZGdd d eZGdd d eZGdd d eZGdd d eZGdd d eZdZdZddddddddd d!d"d#h Zd$d%d&d'd(d)d*gZd)d*d+Zd,Zed-d.d/d0d1gZed2d3d4d5gZd6dZ d7d8Z dmd9d:Z!dnd;d<Z"dod=d>Z#e rd?d@Z$GdAdBdBZ%GdCdde%Z&e rGdDdEdEe%Z'e(dEe)dFkrddl*Z*e*j+dGdHZ,e,j-dIdJdKdLdMe,j-dNdOdPdQdMe,j-dRdSdTe.dUeefdVe,j-dWdXdYe.dZdVe,j-d[d\d]dd^d_e,/Z0e0j1Z1e0jse1dTkr|eZ1e&e0j2e1d`Z3ne1dTkreZ1e'e0j2e1d`Z3e34Z5dae5kre36e37e0j7\Z8Z9Z:Z;Ze?e.e;e0j@dhZ:e3Ae:e;\Z8ZBeBD]Z\ZCZDe eDd%EdidhdZFe eDd$ZGe.eDd*ZHe=djIeCe>eFdke>eGdleHq e3JdS)paAn NNTP client class based on: - RFC 977: Network News Transfer Protocol - RFC 2980: Common NNTP Extensions - RFC 3977: Network News Transfer Protocol (version 2) Example: >>> from nntplib import NNTP >>> s = NNTP('news') >>> resp, count, first, last, name = s.group('comp.lang.python') >>> print('Group', name, 'has', count, 'articles, range', first, 'to', last) Group comp.lang.python has 51 articles, range 5770 to 5821 >>> resp, subs = s.xhdr('subject', '{0}-{1}'.format(first, last)) >>> resp = s.quit() >>> Here 'resp' is the server response line. Error responses are turned into exceptions. To post an article from a file: >>> f = open(filename, 'rb') # file containing article, including header >>> resp = s.post(f) >>> For descriptions of all methods, read the comments in the code below. Note that all arguments and return values representing article numbers are strings, not numbers, since they are rarely used for calculations. NFT) decode_header)_GLOBAL_DEFAULT_TIMEOUTNNTP NNTPErrorNNTPReplyErrorNNTPTemporaryErrorNNTPPermanentErrorNNTPProtocolError NNTPDataErrorric@seZdZdZddZdS)rz%Base class for all nntplib exceptionscGs>tj|f|z|d|_Wntk r8d|_YnXdS)NrzNo response given) Exception__init__responseZ IndexError)selfargsr/usr/lib64/python3.8/nntplib.pyr cs zNNTPError.__init__N)__name__ __module__ __qualname____doc__r rrrrrac@eZdZdZdS)rzUnexpected [123]xx replyNrrrrrrrrrjrc@r)rz 4xx errorsNrrrrrrnrc@r)rz 5xx errorsNrrrrrrrrc@r)rz"Response does not begin with [1-5]Nrrrrrrvrc@r)r zError in response dataNrrrrrr zriwi3Z100Z101211215Z220Z221Z222Z224Z225Z230Z231Z282subjectZfromdatez message-idZ referencesz:bytesz:lines)byteslines GroupInfogrouplastfirstZflag ArticleInfoZnumber message_idrcCsJg}t|D]2\}}t|tr4|||p,dq ||q d|S)zvTakes a unicode string representing a munged header value and decodes it as a (possibly non-ASCII) readable value.Zascii)_email_decode_header isinstancerappenddecodejoin)Z header_strZpartsZvZencrrrrs   cCsg}|D]`}|ddkr:|ddd\}}}d|}n|d\}}}|}t||}||qt}t|t|krtd|dt||krtd|S)zParse a list of string representing the response to LIST OVERVIEW.FMT and return a list of header/metadata names. Raises NNTPDataError if the response is not compliant (cf. RFC 3977, section 8.4).r:Nz$LIST OVERVIEW.FMT response too shortz*LIST OVERVIEW.FMT redefines default fields)Z partitionlower_OVERVIEW_FMT_ALTERNATIVESZgetr(_DEFAULT_OVERVIEW_FMTlenr )rfmtlinenameZ_ZsuffixZdefaultsrrr_parse_overview_fmts    r4cCstt}g}|D]}i}|d^}}t|}t|D]\} } | t|krLq6|| } | d} | |kr| s| d} | r| dt| | krtd| r| t| dnd} | ||| <q6|||fq|S)zZParse the response to an OVER or XOVER command according to the overview format `fmt`.z r+z: Nz?OVER/XOVER response doesn't include names of additional headers) r0r/splitintZ enumerate startswithr-r r()rr1Zdata_process_funcZ n_defaultsZoverviewr2ZfieldsZarticle_numbertokensZiZtokenZ field_nameZ is_metadataZhrrr_parse_overviews&   r9cCs|dkr |dd}|dd}t|dd}t|dd}t|dd}t|dd}t|dd}t|dd}|dkr|d7}n|d kr|d 7}t||||||S) zParse a pair of (date, time) strings, and return a datetime object. If only the date is given, it is assumed to be date and time concatenated together (e.g. response to the DATE command). NiiiFidil)r6datetime)date_strtime_strZhoursZminutesZsecondsyearZmonthZdayrrr_parse_datetimes   rBcCsPt|tjsd}n d|}|j}|r<|d}d||}n d||}||fS)aPFormat a date or datetime object as a pair of (date, time) strings in the format required by the NEWNEWS and NEWGROUPS commands. If a date object is passed, the time is assumed to be midnight (00h00). The returned representation depends on the legacy flag: * if legacy is False (the default): date has the YYYYMMDD format and time the HHMMSS format * if legacy is True: date has the YYMMDD format and time the HHMMSS format. RFC 3977 compliant servers should understand both formats; therefore, legacy is only needed when talking to old servers. Z000000z({0.hour:02d}{0.minute:02d}{0.second:02d}r=z{0:02d}{1.month:02d}{1.day:02d}z{0:04d}{1.month:02d}{1.day:02d})r'r>formatrA)ZdtZlegacyr@Zyr?rrr_unparse_datetimes   rDcCs|dkrt}|j||dS)zWrap a socket in SSL/TLS. Arguments: - sock: Socket to wrap - context: SSL context to use for the encrypted connection Returns: - sock: New, encrypted socket. N)Zserver_hostname)sslZ_create_stdlib_contextZ wrap_socket)sockcontextZhostnamerrr _encrypt_onsrHc@seZdZdZdZdefddZddZdd Zd d Z d d Z ddZ e Z ddZ ddZdhddZddZdiddZddZdjddZdkdd Zd!d"Zd#d$Zd%d&Zdd'd(d)Zdd'd*d+Zdldd'd,d-Zd.d/Zd0d1Zd2d3Zd4d5Zdd'd6d7Zd8d9Z d:d;Z!dmdd?Z#d@dAZ$dndBdCZ%dodd'dDdEZ&dpdd'dFdGZ'dqdd'dHdIZ(dJdKZ)dd'dLdMZ*dd'dNdOZ+dd'dPdQZ,dd'dRdSZ-dTdUZ.dVdWZ/dXdYZ0dZd[Z1d\d]Z2d^d_Z3d`daZ4drdbdcZ5dddeZ6e7rdsdfdgZ8dS)t _NNTPBasezutf-8ZsurrogateescapeNcCsj||_||_d|_||_d|_|d|_|rZd|jkrZ||jsZd|_|d|_ d|_ dS)aSInitialize an instance. Arguments: - file: file-like object (open for read/write in binary mode) - host: hostname of the server - readermode: if true, send 'mode reader' command after connecting. - timeout: timeout (in seconds) used for socket connections readermode is sometimes necessary if you are connecting to an NNTP server on the local machine and intend to call reader-specific commands, such as `group'. If you get unexpected NNTPPermanentErrors, you might need to set readermode. rNFREADER) hostfile debugging_getrespwelcome_capsgetcapabilitiesreadermode_afterauth_setreadermodetls_on authenticated)r rLrK readermodetimeoutrrrr 9s  z_NNTPBase.__init__cCs|SNrr rrr __enter__hsz_NNTPBase.__enter__c sRfdd}|rNz*z Wnttfk r8YnXW5|rLXdS)Ncs tdS)NrL)ZhasattrrrYrrZlsz$_NNTPBase.__exit__..)_closequitOSErrorEOFError)r rZ is_connectedrrYr__exit__ks   z_NNTPBase.__exit__cCs|jrtdt|j|jS)zGet the welcome message from the server (this is read and squirreled away by __init__()). If the response code is 200, posting is allowed; if it 201, posting is not allowed.z *welcome*)rMprintreprrOrYrrr getwelcomevsz_NNTPBase.getwelcomec Cs|jdkrd|_d|_z|\}}Wnttfk rDi|_Ynsz,_NNTPBase._longcmdstring..r~)r r2rLrflistrrYr_longcmdstring s   z_NNTPBase._longcmdstringcCsdz|jWStk rYnXz|d\}}Wn tk rPtdd}Yn Xt|}||_|S)zqInternal: get the overview format. Queries the server if not already done, else returns the cached value.zLIST OVERVIEW.FMTN)Z_cachedoverviewfmtZAttributeErrorrrr/r4)r rfrr1rrr_getoverviewfmtsz_NNTPBase._getoverviewfmtcCsdd|DS)NcSsg|]}t|qSr)rr5rrrrr&z(_NNTPBase._grouplist..r)r rrrr _grouplist$z_NNTPBase._grouplistcCs8i}|d\}}|D]}|^}}|||<q||fS)a!Process a CAPABILITIES command. Not supported by all servers. Return: - resp: server response if successful - caps: a dictionary mapping capability names to lists of tokens (for example {'VERSION': ['2'], 'OVER': [], LIST: ['ACTIVE', 'HEADERS'] }) Z CAPABILITIES)rr5)r rgrfrr2r3r8rrrre(s   z_NNTPBase.capabilities)rLcCsbt|tjtjfs$td|jjt||jdk\}}d||}| ||\}}|| |fS)zProcess a NEWGROUPS command. Arguments: - date: a date or datetime object Return: - resp: server response if successful - list: list of newsgroup names Athe date parameter must be a date or datetime object, not '{:40}'r:zNEWGROUPS {0} {1}) r'r>r TypeErrorrC __class__rrDrdrr)r rrLr?r@cmdrfrrrr newgroups6s z_NNTPBase.newgroupscCsRt|tjtjfs$td|jjt||jdk\}}d|||}| ||S)zProcess a NEWNEWS command. Arguments: - group: group name or '*' - date: a date or datetime object Return: - resp: server response if successful - list: list of message ids rr:zNEWNEWS {0} {1} {2}) r'r>rrrCrrrDrdr)r r rrLr?r@rrrrnewnewsFsz_NNTPBase.newnewscCs4|dk rd|}nd}|||\}}|||fS)a@Process a LIST or LIST ACTIVE command. Arguments: - group_pattern: a pattern indicating which groups to query - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of (group, last, first, flag) (strings) Nz LIST ACTIVE ZLIST)rr)r group_patternrLcommandrfrrrrrVs  z_NNTPBase.listc Cstd}|d|\}}|ds8|d|\}}i}|D]:}||}|r@|dd\} } |sr| S| || <q@|r||fSdSdS)Nz^(?P[^ ]+)[ ]+(.*)$zLIST NEWSGROUPS rXGTITLE r,r:r%)recompilerr7searchstripr ) r rZ return_allline_patrfrZgroupsraw_linematchr3Zdescrrr_getdescriptionses   z_NNTPBase._getdescriptionscC ||dS)aGet a description for a single group. If more than one group matches ('group' is a pattern), return the first. If no group matches, return an empty string. This elides the response code from the server, since it can only be '215' or '285' (for xgtitle) anyway. If the response code is needed, use the 'descriptions' method. NOTE: This neither checks for a wildcard in 'group' nor does it check whether the group actually exists.Fr)r r rrr description|s z_NNTPBase.descriptioncCr)z'Get descriptions for a range of groups.Tr)r rrrr descriptionsrz_NNTPBase.descriptionscCs|d|}|ds t||}d}}}t|}|dkr|d}|dkr|d}|dkr|d}|dkr|d}|t|t|t||fS)aProcess a GROUP command. Argument: - group: the group name Returns: - resp: server response if successful - count: number of articles - first: first article number - last: last article number - name: the group name zGROUP rrr,r:rvr;)r|r7rr5r0r-r6)r r3rfwordscountr"r!Znrrrr s    z_NNTPBase.groupcC |d|S)aProcess a HELP command. Argument: - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of strings returned by the server in response to the HELP command ZHELP)r)r rLrrrhelpsz_NNTPBase.helpcCs8|dst||}t|d}|d}|||fS)z_Internal: parse the response line of a STAT, NEXT, LAST, ARTICLE, HEAD or BODY command.Z22r,r:)r7rr5r6)r rfrart_numr$rrr _statparses   z_NNTPBase._statparsecCs||}||S)z/Internal: process a STAT, NEXT or LAST command.)r|r)r r2rfrrr_statcmds z_NNTPBase._statcmdcCs"|r|d|S|dSdS)a(Process a STAT command. Argument: - message_spec: article number or message id (if not specified, the current article is selected) Returns: - resp: server response if successful - art_num: the article number - message_id: the message id zSTAT {0}ZSTATN)rrC)r message_specrrrstats z_NNTPBase.statcC |dS)z;Process a NEXT command. No arguments. Return as for STAT.ZNEXTrrYrrrnextrz_NNTPBase.nextcCr)z;Process a LAST command. No arguments. Return as for STAT.ZLASTrrYrrrr!rz_NNTPBase.lastcCs0|||\}}||\}}}|t|||fS)z2Internal: process a HEAD, BODY or ARTICLE command.)rrr#)r r2rLrfrrr$rrr_artcmdsz_NNTPBase._artcmdcC$|dk rd|}nd}|||S)a0Process a HEAD command. Argument: - message_spec: article number or message id - file: filename string or file object to store the headers in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of header lines) NzHEAD {0}ZHEADrCrr rrLrrrrhead z_NNTPBase.headcCr)a+Process a BODY command. Argument: - message_spec: article number or message id - file: filename string or file object to store the body in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of body lines) NzBODY {0}ZBODYrrrrrbodyrz_NNTPBase.bodycCr)a5Process an ARTICLE command. Argument: - message_spec: article number or message id - file: filename string or file object to store the article in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of article lines) Nz ARTICLE {0}ZARTICLErrrrrarticlerz_NNTPBase.articlecCr)zYProcess a SLAVE command. Returns: - resp: server response if successful ZSLAVE)r|rYrrrslavesz_NNTPBase.slavecsDtd|d|||\}}fdd|fdd|DfS)aiProcess an XHDR command (optional server extension). Arguments: - hdr: the header type (e.g. 'subject') - str: an article nr, a message id, or a range nr1-nr2 - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of (nr, value) strings z^([0-9]+) ?(.*) ?z XHDR {0} {1}cs|}|r|ddS|S)Nr,r:)rr )r2Zm)patrr remove_number z%_NNTPBase.xhdr..remove_numbercsg|] }|qSrrr)rrrrrz"_NNTPBase.xhdr..)rrrrC)r ZhdrryrLrfrr)rrrxhdr s  z_NNTPBase.xhdrcCs.|d|||\}}|}|t||fS)aFProcess an XOVER command (optional server extension) Arguments: - start: start of range - end: end of range - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of dicts containing the response fields z XOVER {0}-{1})rrCrr9)r startendrLrfrr1rrrxovers z_NNTPBase.xoverc Csxd|jkrdnd}t|ttfr>|\}}|d||p6d7}n|dk rR|d|}|||\}}|}|t||fS)aProcess an OVER command. If the command isn't supported, fall back to XOVER. Arguments: - message_spec: - either a message id, indicating the article to fetch information about - or a (start, end) tuple, indicating a range of article numbers; if end is None, information up to the newest message will be retrieved - or None, indicating the current article number must be used - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of dicts containing the response fields NOTE: the "message id" form isn't supported by XOVER ZOVERZXOVERz {0}-{1}r%Nrc)rPr'ZtuplerrCrrr9) r rrLrrrrfrr1rrrover*s z_NNTPBase.overc Csftdtdtd}|d||\}}g}|D](}||}|r4|| ddq4||fS)zProcess an XGTITLE command (optional server extension) Arguments: - group: group name wildcard (i.e. news.*) Returns: - resp: server response if successful - list: list of (name,title) stringszFThe XGTITLE extension is not actively used, use descriptions() insteadr:z^([^ ]+)[ ]+(.*)$rr,) warningswarnDeprecationWarningrrrrrr(r ) r r rLrrfZ raw_linesrrrrrrxgtitleEs z_NNTPBase.xgtitlecCsltdtd|d|}|ds0t|z|\}}Wntk r^t|dYn X||fSdS)zProcess an XPATH command (optional server extension) Arguments: - id: Message id of article Returns: resp: server response if successful path: directory path to article z(The XPATH extension is not actively usedr:z XPATH {0}Z223N) rrrr|rCr7rr5 ValueError)r ZidrfZresp_numZpathrrrxpathWs z_NNTPBase.xpathcCsb|d}|dst||}t|dkr8t||d}t|dkrTt||t|dfS)zProcess the DATE command. Returns: - resp: server response if successful - date: datetime object ZDATEZ111r:r,iN)r|r7rr5r0r rB)r rfZelemrrrrrks    z_NNTPBase.datecCs||}|dst|t|ttfr2|}|D]:}|tsR| dt}|drdd|}|j |q6|j d|j | S)NZ3rrws. )r|r7rr'rZ bytearrayZ splitlinesZendswithrkZrstriprLrlrmrN)r rZfrfr2rrr_post|s      z_NNTPBase._postcCr)zProcess a POST command. Arguments: - data: bytes object, iterable or file containing the article Returns: - resp: server response if successfulZPOST)r)r datarrrpostsz_NNTPBase.postcCs|d||S)a Process an IHAVE command. Arguments: - message_id: message-id of the article - data: file containing the article Returns: - resp: server response if successful Note that if the server refuses the article an exception is raised.z IHAVE {0})rrC)r r$rrrrihavesz_NNTPBase.ihavecCs|j|`dSrX)rLrxrYrrrr[rz_NNTPBase._closecCsz|d}W5|X|S)zdProcess a QUIT command and close the socket. Returns: - resp: server response if successfulZQUIT)r[r|)r rfrrrr\s z_NNTPBase.quitcCs|jrtd|s|stdz<|rX|sXddl}|}||j}|rX|d}|d}Wntk rnYnX|sxdS|d|}|dr|st|n |d|}|dst |d|_ | |j rd |j kr| d|_ | dS) NzAlready logged in.z7At least one of `user` and `usenetrc` must be specifiedrr:zauthinfo user Z381zauthinfo pass Z281rJ)rUrnetrcZauthenticatorsrKr]r|r7rrrPrQrRrS)r userpasswordusenetrcrZ credentialsZauthrfrrrlogins>     z_NNTPBase.loginc Cs`z|d|_WnJtk r$Yn8tk rZ}z|jdrHd|_nW5d}~XYnXdS)Nz mode readerZ480T)r|rOrrr r7rR)r ZerrrrSs z_NNTPBase._setreadermodecCs||jrtd|jrtd|d}|drp|jt|j||j |_|j d|_d|_d|_ | nt ddS) zzProcess a STARTTLS command. Arguments: - context: SSL context to use for the encrypted connection zTLS is already enabled.z+TLS cannot be started after authentication.STARTTLSZ382rwbTNzTLS failed to start.)rTrrUr|r7rLrxrHrFrKmakefilerPrQr)r rGrfrrrstarttlss    z_NNTPBase.starttls)TrXrXrXrXrXrXrXrXrX)NNTrX)9rrrrprqrr rZr_rbrQrhZdebugrorrrurNr{r|rrrrrerrrrrrr rrrrrr!rrrrrrrrrrrrrrr[r\rrS _have_sslrrrrrrI)sn  /     .         ) rIc@s*eZdZeddddefddZddZdS)rNFc Cs||_||_td|||t||f||_d}z8|jd}t ||||||sZ|rh| |||Wn$|r~| |j YnXdS)a,Initialize an instance. Arguments: - host: hostname to connect to - port: port to connect to (default the standard NNTP port) - user: username to authenticate with - password: password to use with username - readermode: if true, send 'mode reader' command after connecting. - usenetrc: allow loading username and password from ~/.netrc file if not specified explicitly - timeout: timeout (in seconds) used for socket connections readermode is sometimes necessary if you are connecting to an NNTP server on the local machine and intend to call reader-specific commands, such as `group'. If you get unexpected NNTPPermanentErrors, you might need to set readermode. nntplib.connectNr) rKportrirjsocketcreate_connectionrFrrIr rrx) r rKrrrrVrrWrLrrrr s$   z NNTP.__init__cC zt|W5|jXdSrXrFrxrIr[rYrrrr[$z NNTP._close)rrr NNTP_PORTrr r[rrrrrs  %c@s,eZdZedddddefddZddZdS)NNTP_SSLNFc Cstd|||t||f||_d} zJt|j|||_|jd} tj|| |||d|s`|rn| |||Wn$| r| |j YnXdS)zThis works identically to NNTP.__init__, except for the change in default port and the `ssl_context` argument for SSL connections. rNr)rVrW) rirjrrrFrHrrIr rrx) r rKrrrZ ssl_contextrVrrWrLrrrr .s"   zNNTP_SSL.__init__cCrrXrrYrrrr[ErzNNTP_SSL._close)rrr NNTP_SSL_PORTrr r[rrrrr,s rZ__main__zJ nntplib built-in demo - display the latest articles in a newsgroup)rz-gz--groupzgmane.comp.python.generalz3group to fetch messages from (default: %(default)s))defaultrz-sz--serverz news.gmane.ioz+NNTP server hostname (default: %(default)s)z-pz--portrsz#NNTP port number (default: %s / %s))rZtyperz-nz --nb-articlesi z2number of articles to fetch (default: %(default)s)z-Sz--sslZ store_truezuse NNTP over SSL)Zactionrr)rKrrZGroupZhaszarticles, rangeZtocCs$t||kr |d|dd}|S)Nr;z...)r0)sZlimrrrcutps rr,zrrirEZ ImportErrorrZ email.headerrr&rZ__all__rtr rrrrrr rrrzr/r.rkZ namedtuplerr#r4r9rBrDrHrIrrr(rZargparseZArgumentParserZparserZ add_argumentr6Z parse_argsrrZserverrrQrgrr rfrr"r!r3r`rryZ nb_articlesrZ overviewsZartnumrr5ZauthorrrrCr\rrrrZsA           Y.