a
�`�V � @ s� d Z ddlmZ ddlZddlZddlmZmZ ddlm Z ddl
m Z m Z dd� Z
d d
� ZG d d � d e�ZG d
d� de�ZG dd� de�Zd dd�Ze�d�Zdd� Zd!dd�Zd"d d �Zd d � ZdS )#z�
babel.messages.pofile
~~~~~~~~~~~~~~~~~~~~~
Reading and writing of files in the ``gettext`` PO (portable object)
format.
:copyright: (c) 2013-2021 by the Babel Team.
:license: BSD, see LICENSE for more details.
� )�print_functionN)�Catalog�Message)�wraptext)� text_type�cmpc C s" dd� }t �d��|| dd� �S )z�Reverse `escape` the given string.
>>> print(unescape('"Say:\\n \\"hello, world!\\"\\n"'))
Say:
"hello, world!"
<BLANKLINE>
:param string: the string to unescape
c S s2 | � d�}|dkrdS |dkr"dS |dkr.dS |S )N� �n�
�t� �r�
)�group)�match�m� r �9/usr/lib/python3.9/site-packages/babel/messages/pofile.py�replace_escapes s
z!unescape.<locals>.replace_escapesz \\([\\trn"])r ���)�re�compile�sub)�stringr r r r �unescape s
r c C sF d| v r:| � � }| �d�r&|dd� }tt|�}d�|�S t| �S dS )a� Reverse the normalization done by the `normalize` function.
>>> print(denormalize(r'''""
... "Say:\n"
... " \"hello, world!\"\n"'''))
Say:
"hello, world!"
<BLANKLINE>
>>> print(denormalize(r'''""
... "Say:\n"
... " \"Lorem ipsum dolor sit "
... "amet, consectetur adipisicing"
... " elit, \"\n"'''))
Say:
"Lorem ipsum dolor sit amet, consectetur adipisicing elit, "
<BLANKLINE>
:param string: the string to denormalize
r
�""r N� )�
splitlines�
startswith�mapr �join)r Z
escaped_lines�linesr r r � denormalize- s
r" c s e Zd ZdZ� fdd�Z� ZS )� PoFileErrorzDException thrown by PoParser when an invalid po file is encountered.c s0 t t| ��dj||d�� || _|| _|| _d S )Nz{message} on {lineno})�message�lineno)�superr# �__init__�format�catalog�liner% )�selfr$ r) r* r% �� __class__r r r' N s zPoFileError.__init__)�__name__�
__module__� __qualname__�__doc__r' �
__classcell__r r r, r r# L s r# c @ sp e Zd Zdd� Zdd� Zdd� Zdd� ZeZd d
� Zd d � Z d
d� Z
dd� Z dd� Z dd� Z
dd� Zdd� ZdS )�_NormalizedStringc G s g | _ |D ]}| �|� q
d S �N)�_strs�append)r+ �args�argr r r r' W s z_NormalizedString.__init__c C s | j �|�� � d S r4 )r5 r6 �strip)r+ �sr r r r6 \ s z_NormalizedString.appendc C s d� tt| j��S )Nr )r r r r5 �r+ r r r r" _ s z _NormalizedString.denormalizec C s
t | j�S r4 )�boolr5 r; r r r � __nonzero__b s z _NormalizedString.__nonzero__c C s t j�| j�S r4 )�os�linesepr r5 r; r r r �__repr__g s z_NormalizedString.__repr__c C s |sdS t t| �t|��S )Nr )r r �r+ �otherr r r �__cmp__j s z_NormalizedString.__cmp__c C s | � |�dkS �Nr �rC rA r r r �__gt__p s z_NormalizedString.__gt__c C s | � |�dk S rD rE rA r r r �__lt__s s z_NormalizedString.__lt__c C s | � |�dkS rD rE rA r r r �__ge__v s z_NormalizedString.__ge__c C s | � |�dkS rD rE rA r r r �__le__y s z_NormalizedString.__le__c C s | � |�dkS rD rE rA r r r �__eq__| s z_NormalizedString.__eq__c C s | � |�dkS rD rE rA r r r �__ne__ s z_NormalizedString.__ne__N)r. r/ r0 r' r6 r" r= �__bool__r@ rC rF rG rH rI rJ rK r r r r r3 U s r3 c @ sn e Zd ZdZg d�Zddd�Zdd� Zdd � Zd
d � Zdd d
�Z ddd�Z
dd� Z dd� Z dd� Z
dd� ZdS ) � PoFileParserz�Support class to read messages from a ``gettext`` PO (portable object) file
and add them to a `Catalog`
See `read_po` for simple cases.
)�msgid�msgstr�msgctxt� msgid_pluralFc C s* || _ || _d| _d| _|| _| �� d S rD )r) �ignore_obsolete�counter�offset�
abort_invalid�_reset_message_state)r+ r) rR rU r r r r' � s zPoFileParser.__init__c C sF g | _ g | _g | _g | _g | _g | _d | _d| _d| _d| _ d| _
d S )NF) �messages� translations� locations�flags�
user_comments�
auto_comments�context�obsolete�in_msgid� in_msgstr�
in_msgctxtr; r r r rV � s z!PoFileParser._reset_message_statec
C s< | j �� t| j�dkr.tdd� | jD ��}n| jd �� }t|ttf�r�dd� t| j j
�D �}| j D ]2\}}|| j j
kr�| � d| j d� qf|�� ||< qft|�}n| j d d �� }| j
r�| j
�� }nd}t||t| j�t| j�| j| j| j d |d �}| j�r| j�s"|| j j|< n
|| j |< | jd7 _| �� dS )
z�
Add a message to the catalog based on the current parser state and
clear the state ready to process the next message.
r c S s g | ] }|� � �qS r )r" )�.0r r r r �
<listcomp>� � z-PoFileParser._add_message.<locals>.<listcomp>r c S s g | ]}d �qS )r r )rb �_r r r rc � rd r z5msg has more translations than num_plurals of catalogN)r% r] )rX �sort�lenrW �tupler" �
isinstance�list�ranger) � num_plurals�_invalid_pofilerT r] r rY �setrZ r\ r[ r^ rR rS rV )r+ rN r �idx� translationrP r$ r r r � _add_message� s4
�
zPoFileParser._add_messagec C s | j r| �� d S r4 )rW rq r; r r r �_finish_current_message� s z$PoFileParser._finish_current_messagec C s* |� d�r| �||� n| �|||� d S )N�")r �!_process_string_continuation_line�_process_keyword_line)r+ r% r* r^ r r r �_process_message_line� s
z"PoFileParser._process_message_linec C sF | j D ]Z}z4|�|�r<|t|� dv r<|t|�d � }W qtW q ty^ | �||d� Y q0 q| �||d� d S |dv r�| �� || _|dkr�|| _|dv r�d| _d| _ | j
� t |�� n�|d k�r(d| _ d| _
|�d
��r|d d � �d d �\}}| j� t|�t |�g� n| j� d
t |�g� n|dk�rBd| _t |�| _d S )N)� �[z$Keyword must be followed by a stringz0Start of line didn't match any expected keyword.)rN rP rN )rN rQ FTrO rx r �]r rP )� _keywordsr rg �
IndexErrorrm rr r^ rT ra r_ rW r6 r3 r` �splitrX �intr] )r+ r% r* r^ �keywordr8 ro �msgr r r ru � s8
z"PoFileParser._process_keyword_linec C sV | j r| jd }n6| jr(| jd d }n | jr6| j}n| �||d� d S |�|� d S )Nr r z<Got line starting with " but not in msgid, msgstr or msgctxt)r_ rW r` rX ra r] rm r6 )r+ r* r% r: r r r rt � s z.PoFileParser._process_string_continuation_linec C s6 | � � |dd � �d�r�|dd � �� �� D ]p}|�d�}|dkr�zt||d d � �}W n tyr Y q.Y n0 | j�|d |� |f� q.| j�|d f� q.n�|dd � �d�r�|dd � �� �d�D ]}| j �|�
� � q�nP|dd � �d��r|dd � �
� }|�r2| j �|� n| j �|dd � �
� � d S )Nr �:� r �,�.)
rr r �lstripr| �rfindr} �
ValueErrorrY r6 rZ r9 r\ r[ )r+ r* �location�posr% �flag�commentr r r �_process_comment s&
z PoFileParser._process_commentc C s� t |�D ]�\}}|�� }t|t�s0|�| jj�}|s6q|�d�r||dd� �d�rp| j||dd� � � dd� q�| �
|� q| �||� q| � � | j s�| j
s�| js�| jr�| j�td�� | j�d td�g� | �� dS )
z�
Reads from the file-like object `fileobj` and adds any po file
units found in it to the `Catalog` supplied to the constructor.
�#r N�~r� T)r^ r r )� enumerater9 ri r �decoder) �charsetr rv r� r� rr rS rZ r[ r\ rW r6 r3 rX rq )r+ �fileobjr% r* r r r �parse$ s
zPoFileParser.parsec C sJ t |t�sJ �| jr$t|| j||��td|� td�|d t|��� d S )NzWARNING:z!WARNING: Problem on line {0}: {1}r )ri r rU r# r) �printr( �repr)r+ r* r% r r r r rm A s
z PoFileParser._invalid_pofileN)FF)F)F)r. r/ r0 r1 rz r' rV rq rr rv ru rt r� r� rm r r r r rM � s
#
) rM Fc C s* t |||d�}t|||d�}|�| � |S )a� Read messages from a ``gettext`` PO (portable object) file from the given
file-like object and return a `Catalog`.
>>> from datetime import datetime
>>> from babel._compat import StringIO
>>> buf = StringIO('''
... #: main.py:1
... #, fuzzy, python-format
... msgid "foo %(name)s"
... msgstr "quux %(name)s"
...
... # A user comment
... #. An auto comment
... #: main.py:3
... msgid "bar"
... msgid_plural "baz"
... msgstr[0] "bar"
... msgstr[1] "baaz"
... ''')
>>> catalog = read_po(buf)
>>> catalog.revision_date = datetime(2007, 4, 1)
>>> for message in catalog:
... if message.id:
... print((message.id, message.string))
... print(' ', (message.locations, sorted(list(message.flags))))
... print(' ', (message.user_comments, message.auto_comments))
(u'foo %(name)s', u'quux %(name)s')
([(u'main.py', 1)], [u'fuzzy', u'python-format'])
([], [])
((u'bar', u'baz'), (u'bar', u'baaz'))
([(u'main.py', 3)], [])
([u'A user comment'], [u'An auto comment'])
.. versionadded:: 1.0
Added support for explicit charset argument.
:param fileobj: the file-like object to read the PO file from
:param locale: the locale identifier or `Locale` object, or `None`
if the catalog is not bound to a locale (which basically
means it's a template)
:param domain: the message domain
:param ignore_obsolete: whether to ignore obsolete messages in the input
:param charset: the character set of the catalog.
:param abort_invalid: abort read if po file is invalid
)�locale�domainr� )rU )r rM r� )r� r� r� rR r� rU r) �parserr r r �read_poL s /
r� zL(\s+|[^\s\w]*\w+[a-zA-Z]-(?=\w+[a-zA-Z])|(?<=[\w\!\"\'\&\.\,\?])-{2,}(?=\w))c C s0 d| � dd�� dd�� dd�� dd �� d
d � S ) z�Escape the given string so that it can be included in double-quoted
strings in ``PO`` files.
>>> escape('''Say:
... "hello, world!"
... ''')
'"Say:\\n \\"hello, world!\\"\\n"'
:param string: the string to escape
z"%s"�\z\\r z\tr z\rr
z\nrs z\")�replace)r r r r �escape� s ����r� r �L c
s0 |r�|dkr�t � �}g }| �d�D ]�}t t|��| |kr�t�|�}|�� |r�g }d}|r�t t|d ��d | } || |k r�|�|�� � || 7 }qX|s�|�|�� � q�qX|�d�|�� qLq"|�|� q"n
| �d�}t |�dkr�t| �S |�r|d �s|d= |d d7 < dd�� fd d
�|D �� S ) a� Convert a string into a format that is appropriate for .po files.
>>> print(normalize('''Say:
... "hello, world!"
... ''', width=None))
""
"Say:\n"
" \"hello, world!\"\n"
>>> print(normalize('''Say:
... "Lorem ipsum dolor sit amet, consectetur adipisicing elit, "
... ''', width=32))
""
"Say:\n"
" \"Lorem ipsum dolor sit "
"amet, consectetur adipisicing"
" elit, \"\n"
:param string: the string to normalize
:param prefix: a string that should be prepended to every line
:param width: the maximum line width; use `None`, 0, or a negative number
to completely disable line wrapping
r Tr� r r r r
z""
c s g | ]}� t |� �qS r )r� )rb r* ��prefixr r rc � rd z normalize.<locals>.<listcomp>) rg r r� �WORD_SEPr| �reverser6 �popr )
r r� �widthZ prefixlenr! r* �chunks�buf�size�lr r� r � normalize� s6
r� Tc
sb d#�fdd� � ��fdd��d$��fdd� }
d%� ��fdd � } d
} |rLd } n|rTd } t �| d
�D �]�}
|
js�|rrq`�j}�r��dkr�g }|�� D ]}|t|�dd�7 }q�d�|�}�|d � |
jD ] }|
|� q�|
jD ]}|
|dd� q�|�s�g }zt|
j dd� d�}W n t
�y$ |
j }Y n0 |D ]L\}}|�r\| �r\|� d|� t
jd�|f � n|� d|� t
jd� � �q*|
d�|�dd� |
j�r��d d �dgt|
j� � � |
j�r|�r|
d � |
jd � d d� t|
j�d k�r|
d!� |
jd � d d� | |
� �d� q`|�s^t �j�� | d
�D ]0}
|
jD ]}|
|� �q6| |
d"d� �d� �q,d
S )&a� Write a ``gettext`` PO (portable object) template file for a given
message catalog to the provided file-like object.
>>> catalog = Catalog()
>>> catalog.add(u'foo %(name)s', locations=[('main.py', 1)],
... flags=('fuzzy',))
<Message...>
>>> catalog.add((u'bar', u'baz'), locations=[('main.py', 3)])
<Message...>
>>> from babel._compat import BytesIO
>>> buf = BytesIO()
>>> write_po(buf, catalog, omit_header=True)
>>> print(buf.getvalue().decode("utf8"))
#: main.py:1
#, fuzzy, python-format
msgid "foo %(name)s"
msgstr ""
<BLANKLINE>
#: main.py:3
msgid "bar"
msgid_plural "baz"
msgstr[0] ""
msgstr[1] ""
<BLANKLINE>
<BLANKLINE>
:param fileobj: the file-like object to write to
:param catalog: the `Catalog` instance
:param width: the maximum line width for the generated output; use `None`,
0, or a negative number to completely disable line wrapping
:param no_location: do not emit a location comment for every message
:param omit_header: do not include the ``msgid ""`` entry at the top of the
output
:param sort_output: whether to sort the messages in the output by msgid
:param sort_by_file: whether to sort the messages in the output by their
locations
:param ignore_obsolete: whether to ignore obsolete messages and not include
them in the output; by default they are included as
comments
:param include_previous: include the old msgid as a comment when
updating the catalog
:param include_lineno: include line number in the location comment
r c s t | |� d�S )N)r� r� )r� )�keyr� )r� r r �
_normalize s z write_po.<locals>._normalizec s& t | t�r| �� jd�} ��| � d S )N�backslashreplace)ri r �encoder� �write)�text)r) r� r r �_write s
zwrite_po.<locals>._writec s> �r�dkr�}nd}t | |�D ]}� d||�� f � q d S )Nr r� z#%s %s
)r r9 )r� r� �_widthr* )r� r� r r �_write_comment
s
z write_po.<locals>._write_commentc s t | jttf�r�| jr.�d|� | j|�f � �d|� | jd |�f � �d|� | jd |�f � t�j�D ]B}z| j| }W n ty� d}Y n0 �d||� ||�f � qpnR| jrԈd|� | j|�f � �d|� | j|�f � �d|� | jp�d|�f � d S ) Nz
%smsgctxt %s
z %smsgid %s
r z%smsgid_plural %s
r r z%smsgstr[%d] %s
z %smsgstr %s
) ri �idrj rh r] rk rl r r{ )r$ r� ro r )r� r� r) r r �_write_message s2
� �
�
��z write_po.<locals>._write_messageNr$ r� )�sort_byr z# )r� �subsequent_indentr
r� r� c S s" | d t | d t�r | d p dfS )Nr r r )ri r} )�xr r r �<lambda>S rd zwrite_po.<locals>.<lambda>�r� z%s:%d�/z%srw r� z#%s
z, zmsgid %s�|r zmsgid_plural %sz#~ )r )r )r )�_sort_messagesr� Zheader_commentr r r r[ r\ �sortedrY � TypeErrorr6 r� r> �seprZ Z previous_idrg r^ �values)r� r) r� Z no_locationZ omit_headerZ sort_outputZ sort_by_filerR Zinclude_previousZinclude_linenor� r� r� r$ Zcomment_headerr! r* r� ZlocsrY �filenamer% r )r� r� r) r� r� r �write_po� s| .
�
�
���
�
r� c C s6 t | �} |dkr| �� n|dkr2| jdd� d� | S )z�
Sort the given message iterable by the given criteria.
Always returns a list.
:param messages: An iterable of Messages.
:param sort_by: Sort by which criteria? Options are `message` and `location`.
:return: list[Message]
r$ r� c S s | j S r4 )rY )r r r r r� � rd z _sort_messages.<locals>.<lambda>r� )rj rf )rW r� r r r r� v s
r� )NNFNF)r r� )r� FFFFFFT)r1 Z
__future__r r> r Zbabel.messages.catalogr r Z
babel.utilr Z
babel._compatr r r r" � Exceptionr# �objectr3 rM r� r r� r� r� r� r� r r r r �<module> s, / I
5
= �