U AT^ @sdZddlZddlZddlZddlZddlZddlZz ddlZWnek rXdZ YnXdZ ddl m Z ddlm Z ddd d d d d dgZdZGdddeZGdd d eZGdd d eZGdd d eZGdd d eZGdd d eZdZdZddddddddd d!d"d#h Zd$d%d&d'd(d)d*gZd)d*d+Zd,Zed-d.d/d0d1gZed2d3d4d5gZd6dZ d7d8Z dmd9d:Z!dnd;d<Z"dod=d>Z#e rd?d@Z$GdAdBdBZ%GdCdde%Z&e rGdDdEdEe%Z'e(dEe)dFkrddl*Z*e*j+dGdHZ,e,j-dIdJdKdLdMe,j-dNdOdPdQdMe,j-dRdSdTe.dUeefdVe,j-dWdXdYe.dZdVe,j-d[d\d]dd^d_e,/Z0e0j1Z1e0jse1dTkr|eZ1e&e0j2e1d`Z3ne1dTkreZ1e'e0j2e1d`Z3e34Z5dae5kre36e37e0j7\Z8Z9Z:Z;Ze?e.e;e0j@dhZ:e3Ae:e;\Z8ZBeBD]Z\ZCZDe eDd%EdidhdZFe eDd$ZGe.eDd*ZHe=djIeCe>eFdke>eGdleHq e3JdS)paAn NNTP client class based on: - RFC 977: Network News Transfer Protocol - RFC 2980: Common NNTP Extensions - RFC 3977: Network News Transfer Protocol (version 2) Example: >>> from nntplib import NNTP >>> s = NNTP('news') >>> resp, count, first, last, name = s.group('comp.lang.python') >>> print('Group', name, 'has', count, 'articles, range', first, 'to', last) Group comp.lang.python has 51 articles, range 5770 to 5821 >>> resp, subs = s.xhdr('subject', '{0}-{1}'.format(first, last)) >>> resp = s.quit() >>> Here 'resp' is the server response line. Error responses are turned into exceptions. To post an article from a file: >>> f = open(filename, 'rb') # file containing article, including header >>> resp = s.post(f) >>> For descriptions of all methods, read the comments in the code below. Note that all arguments and return values representing article numbers are strings, not numbers, since they are rarely used for calculations. NFT) decode_header)_GLOBAL_DEFAULT_TIMEOUTNNTP NNTPErrorNNTPReplyErrorNNTPTemporaryErrorNNTPPermanentErrorNNTPProtocolError NNTPDataErrorric@seZdZdZddZdS)rz%Base class for all nntplib exceptionscGs>tj|f|z|d|_Wntk r8d|_YnXdS)NrzNo response given) Exception__init__response IndexError)selfargsr/usr/lib64/python3.8/nntplib.pyr cs zNNTPError.__init__N)__name__ __module__ __qualname____doc__r rrrrrasc@seZdZdZdS)rzUnexpected [123]xx replyNrrrrrrrrrjsc@seZdZdZdS)rz 4xx errorsNrrrrrrnsc@seZdZdZdS)rz 5xx errorsNrrrrrrrsc@seZdZdZdS)r z"Response does not begin with [1-5]Nrrrrrr vsc@seZdZdZdS)r zError in response dataNrrrrrr zswi3Z100Z101211215Z220Z221Z222Z224Z225Z230Z231Z282subjectfromdatez message-idZ referencesz:bytesz:lines)byteslines GroupInfogrouplastfirstflag ArticleInfoZnumber message_idrcCsJg}t|D]2\}}t|tr4|||p,dq ||q d|S)zvTakes a unicode string representing a munged header value and decodes it as a (possibly non-ASCII) readable value.ascii)_email_decode_header isinstancerappenddecodejoin)Z header_strpartsvencrrrrs   cCsg}|D]`}|ddkr:|ddd\}}}d|}n|d\}}}|}t||}||qt}t|t|krtd|dt||krtd|S)zParse a list of string representing the response to LIST OVERVIEW.FMT and return a list of header/metadata names. Raises NNTPDataError if the response is not compliant (cf. RFC 3977, section 8.4).r:Nz$LIST OVERVIEW.FMT response too shortz*LIST OVERVIEW.FMT redefines default fields) partitionlower_OVERVIEW_FMT_ALTERNATIVESgetr,_DEFAULT_OVERVIEW_FMTlenr )rfmtlinename_suffixdefaultsrrr_parse_overview_fmts    r@cCstt}g}|D]}i}|d^}}t|}t|D]\} } | t|krLq6|| } | d} | |kr| s| d} | r| dt| | krtd| r| t| dnd} | ||| <q6|||fq|S)zZParse the response to an OVER or XOVER command according to the overview format `fmt`. r2z: Nz?OVER/XOVER response doesn't include names of additional headers) r9r8splitint enumerate startswithr5r r,)rr:Zdata_process_funcZ n_defaultsZoverviewr;fieldsZarticle_numbertokensitoken field_nameZ is_metadatahrrr_parse_overviews&   rLcCs|dkr |dd}|dd}t|dd}t|dd}t|dd}t|dd}t|dd}t|dd}|dkr|d7}n|d kr|d 7}t||||||S) zParse a pair of (date, time) strings, and return a datetime object. If only the date is given, it is assumed to be date and time concatenated together (e.g. response to the DATE command). NiFidil)rCdatetime)date_strtime_strZhoursZminutesZsecondsyearZmonthZdayrrr_parse_datetimes   rWcCsPt|tjsd}n d|}|j}|r<|d}d||}n d||}||fS)aPFormat a date or datetime object as a pair of (date, time) strings in the format required by the NEWNEWS and NEWGROUPS commands. If a date object is passed, the time is assumed to be midnight (00h00). The returned representation depends on the legacy flag: * if legacy is False (the default): date has the YYYYMMDD format and time the HHMMSS format * if legacy is True: date has the YYMMDD format and time the HHMMSS format. RFC 3977 compliant servers should understand both formats; therefore, legacy is only needed when talking to old servers. Z000000z({0.hour:02d}{0.minute:02d}{0.second:02d}rRz{0:02d}{1.month:02d}{1.day:02d}z{0:04d}{1.month:02d}{1.day:02d})r+rSformatrV)ZdtlegacyrUyrTrrr_unparse_datetimes   r[cCs|dkrt}|j||dS)zWrap a socket in SSL/TLS. Arguments: - sock: Socket to wrap - context: SSL context to use for the encrypted connection Returns: - sock: New, encrypted socket. N)Zserver_hostname)sslZ_create_stdlib_contextZ wrap_socket)sockcontexthostnamerrr _encrypt_onsr`c@seZdZdZdZdefddZddZdd Zd d Z d d Z ddZ e Z ddZ ddZdhddZddZdiddZddZdjddZdkdd Zd!d"Zd#d$Zd%d&Zdd'd(d)Zdd'd*d+Zdldd'd,d-Zd.d/Zd0d1Zd2d3Zd4d5Zdd'd6d7Zd8d9Z d:d;Z!dmdd?Z#d@dAZ$dndBdCZ%dodd'dDdEZ&dpdd'dFdGZ'dqdd'dHdIZ(dJdKZ)dd'dLdMZ*dd'dNdOZ+dd'dPdQZ,dd'dRdSZ-dTdUZ.dVdWZ/dXdYZ0dZd[Z1d\d]Z2d^d_Z3d`daZ4drdbdcZ5dddeZ6e7rdsdfdgZ8dS)t _NNTPBasezutf-8surrogateescapeNcCsj||_||_d|_||_d|_|d|_|rZd|jkrZ||jsZd|_|d|_ d|_ dS)aSInitialize an instance. Arguments: - file: file-like object (open for read/write in binary mode) - host: hostname of the server - readermode: if true, send 'mode reader' command after connecting. - timeout: timeout (in seconds) used for socket connections readermode is sometimes necessary if you are connecting to an NNTP server on the local machine and intend to call reader-specific commands, such as `group'. If you get unexpected NNTPPermanentErrors, you might need to set readermode. rNFREADER) hostfile debugging_getrespwelcome_capsgetcapabilitiesreadermode_afterauth_setreadermodetls_on authenticated)rrerd readermodetimeoutrrrr 9s  z_NNTPBase.__init__cCs|SNrrrrr __enter__hsz_NNTPBase.__enter__c sRfdd}|rNz*z Wnttfk r8YnXW5|rLXdS)Ncs tdS)Nre)hasattrrrrrrlz$_NNTPBase.__exit__..)_closequitOSErrorEOFError)rrZ is_connectedrrrr__exit__ks   z_NNTPBase.__exit__cCs|jrtdt|j|jS)zGet the welcome message from the server (this is read and squirreled away by __init__()). If the response code is 200, posting is allowed; if it 201, posting is not allowed.z *welcome*)rfprintreprrhrrrrr getwelcomevsz_NNTPBase.getwelcomec Cs|jdkrd|_d|_z|\}}Wnttfk rDi|_Ynsz,_NNTPBase._longcmdstring..r)rr;rerlistrrrr_longcmdstring s   z_NNTPBase._longcmdstringcCsdz|jWStk rYnXz|d\}}Wn tk rPtdd}Yn Xt|}||_|S)zqInternal: get the overview format. Queries the server if not already done, else returns the cached value.zLIST OVERVIEW.FMTN)Z_cachedoverviewfmtAttributeErrorrrr8r@)rrrr:rrr_getoverviewfmtsz_NNTPBase._getoverviewfmtcCsdd|DS)NcSsg|]}t|qSr)r!rBrrrrr&sz(_NNTPBase._grouplist..r)rrrrr _grouplist$sz_NNTPBase._grouplistcCs8i}|d\}}|D]}|^}}|||<q||fS)a!Process a CAPABILITIES command. Not supported by all servers. Return: - resp: server response if successful - caps: a dictionary mapping capability names to lists of tokens (for example {'VERSION': ['2'], 'OVER': [], LIST: ['ACTIVE', 'HEADERS'] }) Z CAPABILITIES)rrB)rrrrr;r<rGrrrr(s   z_NNTPBase.capabilities)recCsbt|tjtjfs$td|jjt||jdk\}}d||}| ||\}}|| |fS)zProcess a NEWGROUPS command. Arguments: - date: a date or datetime object Return: - resp: server response if successful - list: list of newsgroup names Athe date parameter must be a date or datetime object, not '{:40}'rMzNEWGROUPS {0} {1}) r+rSr TypeErrorrX __class__rr[rrr)rrrerTrUcmdrrrrr newgroups6s z_NNTPBase.newgroupscCsRt|tjtjfs$td|jjt||jdk\}}d|||}| ||S)zProcess a NEWNEWS command. Arguments: - group: group name or '*' - date: a date or datetime object Return: - resp: server response if successful - list: list of message ids rrMzNEWNEWS {0} {1} {2}) r+rSrrrXrrr[rr)rr"rrerTrUrrrrnewnewsFsz_NNTPBase.newnewscCs4|dk rd|}nd}|||\}}|||fS)a@Process a LIST or LIST ACTIVE command. Arguments: - group_pattern: a pattern indicating which groups to query - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of (group, last, first, flag) (strings) Nz LIST ACTIVE LIST)rr)r group_patternrecommandrrrrrrVs  z_NNTPBase.listc Cstd}|d|\}}|ds8|d|\}}i}|D]:}||}|r@|dd\} } |sr| S| || <q@|r||fSdSdS)Nz^(?P[^ ]+)[ ]+(.*)$zLIST NEWSGROUPS rXGTITLE r3rMr))recompilerrEsearchstripr") rrZ return_allline_patrrgroupsraw_linematchr<Zdescrrr_getdescriptionses   z_NNTPBase._getdescriptionscCs ||dS)aGet a description for a single group. If more than one group matches ('group' is a pattern), return the first. If no group matches, return an empty string. This elides the response code from the server, since it can only be '215' or '285' (for xgtitle) anyway. If the response code is needed, use the 'descriptions' method. NOTE: This neither checks for a wildcard in 'group' nor does it check whether the group actually exists.Fr)rr"rrr description|s z_NNTPBase.descriptioncCs ||dS)z'Get descriptions for a range of groups.Tr)rrrrr descriptionssz_NNTPBase.descriptionscCs|d|}|ds t||}d}}}t|}|dkr|d}|dkr|d}|dkr|d}|dkr|d}|t|t|t||fS)aProcess a GROUP command. Argument: - group: the group name Returns: - resp: server response if successful - count: number of articles - first: first article number - last: last article number - name: the group name zGROUP rrr3rMrrN)rrErrBr9r5rC)rr<rwordscountr$r#nrrrr"s    z_NNTPBase.groupcCs |d|S)aProcess a HELP command. Argument: - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of strings returned by the server in response to the HELP command ZHELP)r)rrerrrhelpsz_NNTPBase.helpcCs8|dst||}t|d}|d}|||fS)z_Internal: parse the response line of a STAT, NEXT, LAST, ARTICLE, HEAD or BODY command.Z22r3rM)rErrBrC)rrrart_numr'rrr _statparses   z_NNTPBase._statparsecCs||}||S)z/Internal: process a STAT, NEXT or LAST command.)rr)rr;rrrr_statcmds z_NNTPBase._statcmdcCs"|r|d|S|dSdS)a(Process a STAT command. Argument: - message_spec: article number or message id (if not specified, the current article is selected) Returns: - resp: server response if successful - art_num: the article number - message_id: the message id zSTAT {0}ZSTATN)rrX)r message_specrrrstats z_NNTPBase.statcCs |dS)z;Process a NEXT command. No arguments. Return as for STAT.ZNEXTrrrrrrnextsz_NNTPBase.nextcCs |dS)z;Process a LAST command. No arguments. Return as for STAT.ZLASTrrrrrrr#sz_NNTPBase.lastcCs0|||\}}||\}}}|t|||fS)z2Internal: process a HEAD, BODY or ARTICLE command.)rrr&)rr;rerrrr'rrr_artcmdsz_NNTPBase._artcmdcCs$|dk rd|}nd}|||S)a0Process a HEAD command. Argument: - message_spec: article number or message id - file: filename string or file object to store the headers in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of header lines) NzHEAD {0}ZHEADrXrrrrerrrrheads z_NNTPBase.headcCs$|dk rd|}nd}|||S)a+Process a BODY command. Argument: - message_spec: article number or message id - file: filename string or file object to store the body in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of body lines) NzBODY {0}ZBODYrrrrrbodys z_NNTPBase.bodycCs$|dk rd|}nd}|||S)a5Process an ARTICLE command. Argument: - message_spec: article number or message id - file: filename string or file object to store the article in Returns: - resp: server response if successful - ArticleInfo: (article number, message id, list of article lines) Nz ARTICLE {0}ZARTICLErrrrrarticles z_NNTPBase.articlecCs |dS)zYProcess a SLAVE command. Returns: - resp: server response if successful ZSLAVE)rrrrrrslavesz_NNTPBase.slavecsDtd|d|||\}}fdd|fdd|DfS)aiProcess an XHDR command (optional server extension). Arguments: - hdr: the header type (e.g. 'subject') - str: an article nr, a message id, or a range nr1-nr2 - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of (nr, value) strings z^([0-9]+) ?(.*) ?z XHDR {0} {1}cs|}|r|ddS|S)Nr3rM)rr")r;m)patrr remove_numbers z%_NNTPBase.xhdr..remove_numbercsg|] }|qSrrr)rrrrsz"_NNTPBase.xhdr..)rrrrX)rZhdrrrerrr)rrrxhdr s  z_NNTPBase.xhdrcCs.|d|||\}}|}|t||fS)aFProcess an XOVER command (optional server extension) Arguments: - start: start of range - end: end of range - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of dicts containing the response fields z XOVER {0}-{1})rrXrrL)rstartendrerrr:rrrxovers z_NNTPBase.xoverc Csxd|jkrdnd}t|ttfr>|\}}|d||p6d7}n|dk rR|d|}|||\}}|}|t||fS)aProcess an OVER command. If the command isn't supported, fall back to XOVER. Arguments: - message_spec: - either a message id, indicating the article to fetch information about - or a (start, end) tuple, indicating a range of article numbers; if end is None, information up to the newest message will be retrieved - or None, indicating the current article number must be used - file: Filename string or file object to store the result in Returns: - resp: server response if successful - list: list of dicts containing the response fields NOTE: the "message id" form isn't supported by XOVER ZOVERZXOVERz {0}-{1}r)Nr)rir+tuplerrXrrrL) rrrerrrrrr:rrrover*s z_NNTPBase.overc Csftdtdtd}|d||\}}g}|D](}||}|r4|| ddq4||fS)zProcess an XGTITLE command (optional server extension) Arguments: - group: group name wildcard (i.e. news.*) Returns: - resp: server response if successful - list: list of (name,title) stringszFThe XGTITLE extension is not actively used, use descriptions() insteadrMz^([^ ]+)[ ]+(.*)$rr3) warningswarnDeprecationWarningrrrrrr,r") rr"rerrZ raw_linesrrrrrrxgtitleEs z_NNTPBase.xgtitlecCsltdtd|d|}|ds0t|z|\}}Wntk r^t|dYn X||fSdS)zProcess an XPATH command (optional server extension) Arguments: - id: Message id of article Returns: resp: server response if successful path: directory path to article z(The XPATH extension is not actively usedrMz XPATH {0}Z223N) rrrrrXrErrB ValueError)ridrZresp_numpathrrrxpathWs z_NNTPBase.xpathcCsb|d}|dst||}t|dkr8t||d}t|dkrTt||t|dfS)zProcess the DATE command. Returns: - resp: server response if successful - date: datetime object ZDATEZ111rMr3N)rrErrBr9r rW)rrelemrrrrrks    z_NNTPBase.datecCs||}|dst|t|ttfr2|}|D]:}|tsR| dt}|drdd|}|j |q6|j d|j | S)N3r rs. )rrErr+r bytearray splitlinesendswithrrstriprerrrg)rrfrr;rrr_post|s      z_NNTPBase._postcCs |d|S)zProcess a POST command. Arguments: - data: bytes object, iterable or file containing the article Returns: - resp: server response if successfulZPOST)r)rdatarrrpostsz_NNTPBase.postcCs|d||S)a Process an IHAVE command. Arguments: - message_id: message-id of the article - data: file containing the article Returns: - resp: server response if successful Note that if the server refuses the article an exception is raised.z IHAVE {0})rrX)rr'rrrrihavesz_NNTPBase.ihavecCs|j|`dSrq)rerrrrrrrws z_NNTPBase._closecCsz|d}W5|X|S)zdProcess a QUIT command and close the socket. Returns: - resp: server response if successfulZQUIT)rwr)rrrrrrxs z_NNTPBase.quitcCs|jrtd|s|stdz<|rX|sXddl}|}||j}|rX|d}|d}Wntk rnYnX|sxdS|d|}|dr|st|n |d|}|dst |d|_ | |j rd |j kr| d|_ | dS) NzAlready logged in.z7At least one of `user` and `usenetrc` must be specifiedrrMzauthinfo user Z381zauthinfo pass Z281rc)rnrnetrcZauthenticatorsrdryrrErrrirjrkrl)ruserpasswordusenetrcrZ credentialsZauthrrrrlogins>     z_NNTPBase.loginc Cs`z|d|_WnJtk r$Yn8tk rZ}z|jdrHd|_nW5d}~XYnXdS)Nz mode readerZ480T)rrhrrr rErk)rerrrrls z_NNTPBase._setreadermodecCs||jrtd|jrtd|d}|drp|jt|j||j |_|j d|_d|_d|_ | nt ddS) zzProcess a STARTTLS command. Arguments: - context: SSL context to use for the encrypted connection zTLS is already enabled.z+TLS cannot be started after authentication.STARTTLSZ382rwbTNzTLS failed to start.)rmrrnrrErerr`r]rdmakefilerirjr)rr^rrrrstarttlss    z_NNTPBase.starttls)T)N)N)N)N)N)N)N)N)N)NNT)N)9rrrrrrr rsr{r~rjrdebugrrrrgrrrrrrrrrrrrrr"rrrrrr#rrrrrrrrrrrrrrrwrxrrl _have_sslrrrrrra)sn  /     .         ) rac@s*eZdZeddddefddZddZdS)rNFc Cs||_||_td|||t||f||_d}z8|jd}t ||||||sZ|rh| |||Wn$|r~| |j YnXdS)a,Initialize an instance. Arguments: - host: hostname to connect to - port: port to connect to (default the standard NNTP port) - user: username to authenticate with - password: password to use with username - readermode: if true, send 'mode reader' command after connecting. - usenetrc: allow loading username and password from ~/.netrc file if not specified explicitly - timeout: timeout (in seconds) used for socket connections readermode is sometimes necessary if you are connecting to an NNTP server on the local machine and intend to call reader-specific commands, such as `group'. If you get unexpected NNTPPermanentErrors, you might need to set readermode. nntplib.connectNr) rdportrrsocketcreate_connectionr]rrar rr) rrdrrrrorrprerrrr s$   z NNTP.__init__cCs zt|W5|jXdSrqr]rrarwrrrrrrw$sz NNTP._close)rrr NNTP_PORTrr rwrrrrrs  %c@s,eZdZedddddefddZddZdS)NNTP_SSLNFc Cstd|||t||f||_d} zJt|j|||_|jd} tj|| |||d|s`|rn| |||Wn$| r| |j YnXdS)zThis works identically to NNTP.__init__, except for the change in default port and the `ssl_context` argument for SSL connections. rNr)rorp) rrrrr]r`rrar rr) rrdrrrZ ssl_contextrorrprerrrr .s"   zNNTP_SSL.__init__cCs zt|W5|jXdSrqrrrrrrrwEszNNTP_SSL._close)rrr NNTP_SSL_PORTrr rwrrrrr,s r__main__zJ nntplib built-in demo - display the latest articles in a newsgroup)rz-gz--groupzgmane.comp.python.generalz3group to fetch messages from (default: %(default)s))defaultrz-sz--serverz news.gmane.ioz+NNTP server hostname (default: %(default)s)z-pz--portrz#NNTP port number (default: %s / %s))r typerz-nz --nb-articles z2number of articles to fetch (default: %(default)s)z-Sz--ssl store_truezuse NNTP over SSL)actionr r)rdrrZGroupZhaszarticles, rangetocCs$t||kr |d|dd}|S)NrNz...)r9)sZlimrrrcutps rr3sA           Y.