Current File : //opt/alt/python37/lib/python3.7/site-packages/clcommon/__pycache__/utils.cpython-37.pyc
B
E!wd�n � @ sH d dl mZ d dl mZ d dl mZ d dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlmZ d dlmZmZ d dlmZmZmZmZmZmZ d dlZd dlm Z d dl Z d d l m Z d d
l m!Z!m"Z"m#Z#m$Z$ d Z%d Z&d
Z'dd� Z(dpdd�Z)dd� Z*dd� Z+dd� Z,dd� Z-dqd d �Z.d d � Z/ee0 d �d!d"�Z1d#d$� Z2e3d �d%d&�Z4ee0 d �d'd(�Z5edd)�ee0 d �d*d+��Z6e7d,�d-d.�Z8e0e3d/�d0d1�Z9e3d �d2d3�Z:e3d �d4d5�Z;d6d7� Z<d8d9� Z=d:d;� Z>d<d=� Z?d>d?� Z@d@dA� ZAdBdC� ZBe0e3dD�dEdF�ZCe7e3dG�dHdI�ZDeee3 dJ�dKdL�ZEe7d �dMdN�ZFe0ee3e3f dO�dPdQ�ZGe0ee3e3f dO�dRdS�ZHe0ee3e3f dO�dTdU�ZIe0e3e3dV�dWdX�ZJee
j
e
jKf e0dY�dZd[�ZLdre0e0e0e7ee7e0f d\�d]d^�ZMe0d �d_d`�ZNe3d �dadb�ZOe0ee7 dc�ddde�ZPe0df�dgdh�ZQe0df�didj�ZRdkdl� ZSe0e0dm�dndo�ZTdS )s� )�print_function)�absolute_import)�divisionN)� lru_cache)� ConfigParser�Error)�Dict�Any�AnyStr�Optional�Tuple�Union)�etree)� is_ubuntu)�
check_command� run_command� exec_utility�ExternalProgramFailedz/etc/sysconfig/rhn/systemid)ZMonZTueZWedZThuZFriZSatZSunz /opt/cloudlinux/litespeed_statusc C sp d}t j�|�r4yt �|�}W n tk
r2 Y nX | |krlyt �|� W n tk
r^ Y nX t �| |� dS )a
Create symlink link_path -> link_value if it does not exist or
points to different location
:param link_value: path that symlink should point to (symlink value)
:type link_value: str
:param link_path: path where to create symlink
:type link_path: str
N)�os�path�islink�readlink�OSError�unlink�symlink)Z
link_valueZ link_pathZlink_to� r �?/opt/alt/python37/lib/python3.7/site-packages/clcommon/utils.py�create_symlink2 s r c C s6 g }t j�| �r2t| d|d��}|�� }W dQ R X |S )a
Read file and return file's lines
errors param may be passed to define how handle
unicode errors, errors=None is default value of open()
:param path: path to file
:param unicode_errors_handle: how to handle unicode errors
:return: list of file's lines
�r)�errorsN)r r �isfile�open� readlines)r Zunicode_errors_handle�content�fr r r �get_file_linesI s
r% c C s$ t | |��}|�|� W dQ R X dS )z�
Write lines to file
:param content: list of lines for writing to file
:param path: path to file
:param mode: open mode
:return: None
N)r! �
writelines)r r# �moder$ r r r �write_file_linesZ s r( c s: t | �}� fdd�|D �}t|�t|�k}t| |d� |S )a
Delete line from file. Return True when line(s) have been deleted, False otherwise (specified line is not found)
:param path: path to file
:type path: string
:param line: line to delete without EOL ('
')
:type line: string
:rtype bool
c s g | ]}� |� d �kr|�qS )�
)�rstrip)�.0�item)�liner r �
<listcomp>q s z)delete_line_from_file.<locals>.<listcomp>zw+)r% �lenr( )r r- Z
file_linesZout_file_lines�foundr )r- r �delete_line_from_fileg s
r1 c C sn t �� } | dkrjy,t�d�j}|t �� ks6t �� |kr:dS W n tk
rP Y nX tdt j
d� t � d� dS )zH
Check whether current user is effectively root and exit if not
r Z
clsupergidNz'Error: root privileges required. Abort.)�file���) r �geteuid�grpZgetgrnam�gr_gid� getgroups�getegid�KeyError�print�sys�stderr�exit)Zeuidr6 r r r �is_root_or_exitx s r> c C s t j�d�S )zV
Detects is EA4 installed
:return: True - EA4 present; False - EA4 absent
z/etc/cpanel/ea4/is_ea4)r r r r r r r �is_ea4� s r? FTc c s� |dkrt |�}d}|s<| �d�s0|s0d�| �} t�| �}nd}xh|D ]`}|rv|rf|�| �dkrf|}q�|�| �r�|}n|�|�r�|}|r�|dk r�|V n
|dk r�P d}qFW |dk r�|V dS )a
Grep pattern in file
:param multiple_search: if True - search all match,
False - search first match
:param pattern: pattern for search
:param path: path to file
:param data_from_file: read data from file for parsing
:param fixed_string: if True - search only fixed string,
False - search by regexp
:param match_any_position: if True - search any match position,
False - search only from string begin
:return: Generator with matched strings
N�^z^{}r3 )r% �
startswith�format�re�compile�find�search) �patternr � fixed_stringZmatch_any_position�multiple_search�data_from_file�resultZ pattern_compr- r r r �grep� s.
rL c C s
t �t�S )z-
:rtype: lxml.etree._ElementTree obj
)r �parse�RHN_SYSTEMID_FILEr r r r �_parse_systemid_file� s rO )�returnc C sb y>t � }x2|�d�D ]$}|�d�j| kr|�d�d jS qW W n ttttjfk
r\ dS X dS )z`
find a member in xml by name and return value
:type name: str
:rtype: str|None
�member�name�valuer N) rO �iterrE �text�IOError�
IndexErrorr9 r Z
ParseError)rR Zrhn_systemid_xmlrQ r r r �get_rhn_systemid_value� s rX c
C s� dd| d�}t j�| �s |S yLtjd| gdddd��� }tjd| gdddd��� }d|d < ||d
< W n< tjtfk
r� } zd | |f }||d
< W d d }~X Y nX |S )
aZ
This function is written for detect file system in which file is stored on.
E.g., the file can be stored in NFS and this can affect the normal operation of the file.
We want to receive information about FS in emergency situations during reading or writing
:param file_path: path to file, for which we want to detect file system
:return: dict, which contains two keys:
key 'success' can be equals to False if we got error or True if we got normal result
key 'details' can contais error string if key 'success' is False or result if key 'success' is True
FzFile "%s" isn't exists)�success�detailsz%df %s | tail -n 1 | awk '{print $NF}'Tz /bin/bash)�shell�
executablerU zmount | grep "on %s type"rY rZ z6We can't get file system for file "%s". Exception "%s"N)r r �exists�
subprocess� check_output�strip�CalledProcessErrorr )Z file_pathrK Z mount_point�data�errr r r �*get_file_system_in_which_file_is_stored_on� s. rd c C sD t ddd�} y| �d� | �dd�}W n tk
r> d}Y nX |S )z�
Checks if testing is enabled in /etc/yum.repos.d/cloudlinux.repo config
:return: bool value if testing enabled or not
NF)Z
interpolation�strictz /etc/yum.repos.d/cloudlinux.repozcloudlinux-updates-testingZenabled)r �readZ
getbooleanr )�parserZresr r r �is_testing_enabled_repo s
rh c C s� t � r
dS ddddddd�} t�� }x | D ]}|r*||kr*| | S q*W td�}d }|d kr`d }n6d
|krnd}n(d |kr|d}nd |kr�d}n d
|kr�d}|S )a
Returns cl version taking into account release version
E.g: release =
2.6.32-896.16.1.lve1.4.54.el6.x86_64
5.14.0-162.6.1.el9_1.x86_64
el6 = cl6
el8 = cl8
........
ubuntu+cl_extesions = cl8
:return appropriate version string
�cl8�cl6Zcl6hZcl7Zcl7hZcl9)zel6.zel6h.zel7.zel7h.zel8.z.el9Z
os_releaseN�6�7�8�9)r �platform�releaserX )Zcheck_vals_decoderrp Z check_valZret_valr r r �get_cl_version s2
rq )�maxsizec C sL yt dg��� } W n tjtfk
r, dS X | dkrD| �d�d S dS dS )a�
Returns virtualization type on current system.
It is reachable via virt-what utility.
E.g.: 'kvm', 'bhyve', 'openvz', 'qemu'
All acceptable outputs are listed here:
https://people.redhat.com/~rjones/virt-what/virt-what.txt
Output will be returned with at least two rows
Sample:
> kvm
>
Furthermore, there is a possibility for multiple text rows
Sample:
> xen
> xen-domU
That's why, the result will be taken from a first row.
If the output is empty, and there were no errors, the machine
is either non-virtual, or virt-what tool isn't familiar with it's
hypervisor. But the list of supported hypervisors and containers
covers all popular VMs types.
:return: virt_type - Optional[AnyStr]
- appropriate virtualization type string,
- 'physical' if there is no virtualization,
- None if there was an error
z/usr/sbin/virt-whatN� r) r Zphysical)r r` r^ ra �FileNotFoundError�split)Zvirt_what_outputr r r �
get_virt_type@ s rv )�pidc C s. yt �| d� W n tk
r$ dS X dS dS )z�
Checks for a process existence by os.kill command
If os.kill will be used as os.kill(pid, 0), it will
just check for a presence of such PID
And if such pid can't be reached with kill method,
there will be raised OSError
r FTN)r �killr )rw r r r � check_pidg s
ry )�
pid_file_pathrP c C sN t j�| �rJt| ��0}ytt|�� �� ��S tk
r> Y nX W dQ R X dS )z�Check if process running using pid file
Arguments:
pid_file_path: path to the pid file of service
Returns:
bool: True or False
NF) r r r r! ry �intrf r` �
ValueError)rz r$ r r r �is_process_runningx s
r} c C sT t �� dkrd} t| �S t j�t�s(dS tt��}|�� �� }W dQ R X |dkS dS )a
Detects that server works under Litespeed.
Note: be careful when modifying this method.
It is used in X-Ray, ask @dkavchuk or someone else from C-Projects team
for details.
return: True - LS working; False - LS not running (stopped or absent)
r z/tmp/lshttpd/lshttpd.pidFN�0) r r4 r} r r] �LITESPEED_STATUS_FOR_USERSr! rf r` )rz r$ �statusr r r �is_litespeed_running� s
r� c C s d} t | �S )zHCheck if nginx is running
Returns:
Bool: True or False
z/run/nginx.pid)r} )rz r r r �is_nginx_running� s r� c C s t � r
dS dS )zU
Return proper passenger package according to apache version
:rtype: str
zapache24-passengerzalt-mod-passenger)r? r r r r �get_passenger_package_name� s r� c C sB y(t � rtdd| g� ntdd| g� W n tk
r< dS X dS )z_
Checks that package installed on server
:param package_name: str
:rtype: bool
�dpkgz-sZrpmz-qFT)r r r )Z package_namer r r �is_package_installed� s r� c C s t � r t� S t� S dS )z�
Pick the package manager to check depending on the OS.
If we're not on Ubuntu, assume a CL variant with RPM.
:return: Error string, if any, None otherwise.
N)r �get_apt_db_errors�get_rpm_db_errorsr r r r �get_package_db_errors� s r� c
C sx yHt jddgdt jt jdd�} | �� \}}| jdkrFd|� d|� d �S W n* ttfk
rr } zt|�S d
}~X Y nX d
S ) z�
Check the dpkg DB as described in https://man7.org/linux/man-pages/man1/dpkg.1.html
See `--audit`.
:return: Error string, if any, None otherwise.
r� z--auditFT)r[ �stdoutr< rU r zdpkg audit error: r) �.N)r^ �Popen�PIPE� communicate�
returncoder rV �str)�prc�std_out�std_errrc r r r r� � s
r� c
C s� d} yNt jddddgt jt jdd�}|�� \}}|jdkrPd |� d
|� d | � �S W n* ttfk
r| } zt|�S d }~X Y nX d S )
zx
Check RPM DB consistency.
:return: None - No RPM DB errors
string_message - Error description
zjhttps://cloudlinux.zendesk.com/hc/en-us/articles/115004075294-Fix-rpmdb-Thread-died-in-Berkeley-DB-libraryz/bin/rpmz--dbpathz /var/lib/rpmz
--verifydbT)r� r< rU r zRPM DB check error: r) z .
See doc: N)r^ r� r� r� r� r rV r� )Zdoc_linkr� r� r� rc r r r r� � s
r� c C s t �� t_t �� t_dS )a(
Upon process exit, Sentry sometimes prints:
Sentry is attempting to send 1 pending error messages
Waiting up to 10 seconds
Press Ctrl-C to quit
This causes broken JSON in output.
See also this issue: https://github.com/getsentry/raven-python/issues/904
N)�io�StringIOr; r� r< r r r r �!silence_stdout_until_process_exit s
r� c C s2 d|d@ }t �|�� t�| |� W dQ R X dS )a
Create directories with desired permissions
Changed in version 3.7: The mode argument no longer affects
the file permission bits of newly-created intermediate-level directories.
Because it we use umask while creating dirs
:param mod: desired permissions
i� N)�secureioZ set_umaskr �makedirs)r �modZ inverted_modr r r � mod_makedirs s
r� )�usernamerP c C s( yt �| � W n tk
r" dS X dS )z,
Check user existence in the system
FT)�pwd�getpwnamr9 )r� r r r �is_user_present' s
r� )�uidrP c C s( yt �| � W n tk
r" dS X dS )z+
Check uid existence in the system
FT)r� �getpwuidr9 )r� r r r �is_uid_present2 s
r� )r rP c
C s: yt �| �j}W n tttfk
r* dS X t�|�}|S )z+
Check that file by path is socket
N)r �lstat�st_modert rV r �stat�S_ISSOCK)r r' Z is_socketr r r �is_socket_file= s
r� c C s: t jddddd�} | �� �� d }|dkr.dnt|�}|S )z?
Get number of system run level by command `runlevel`.
z/sbin/runlevelTz /bin/bash)r[ r\ rU � �S)r^ r_ r` ru r{ )�outputrK �levelr r r �get_system_runlevelJ s r� )� service_namerP c C s� t � }y tjd| � �dddd�}W n tjtfk
r< dS X |�� �� }xJ|dd� D ]:}|�� �d�}|d d k}t|d
�}||krXd|fS qXW d S ) z�
Returns state of a service (present and enabled) for init.d system.
Returns False, False if a service doesn't exist
Returns True, False if a service exists and it's not enabled
Returns True, True if a service exists and it's enabled
z LANG=C /sbin/chkconfig --list Tz /bin/bash)r[ r\ rU )FFr� N�:Zonr )TF)r� r^ r_ ra rt r` ru r{ )r� Zrunlevelr� Z output_listZ
state_infoZ
state_listZ is_activeZstate_runlevelr r r �#_get_service_state_on_init_d_system] s" r� c C s� y t jd| � d�ddd� dS t jtfk
r� y8t jdd| gt jt jd �}|�� |jd
krdd S d S W n t jtfk
r� d S X Y nX d
S )z�
Returns state of service (present and enabled) for systemd system
Returns False, False if a service doesn't exist
Returns True, False if a service exists and it's not enabled
Returns True, True if a service exists and it's enabled
z /usr/bin/systemctl is-enabled z
&> /dev/nullTz /bin/bash)r[ r\ )TTz/usr/bin/systemctlr� )r< r� )r � )TF)FFN)r^ Z
check_callra rt r� ZDEVNULLr� r� )r� �pr r r �$_get_service_state_on_systemd_system s(
r� c C s8 t � }|r"d|kr"t| d�\}}nt| d�\}}||fS )zc
Returns state of service (present and enabled)
:param service_name: name of a service
rj )r� )rq r� r� )r� Zcl_verZ
is_presentZ
is_enabledr r r � service_is_enabled_and_present� s r� )�process_file_path� strict_matchrP c C s~ t j�| �s td| � d���x\t�dg�D ]L}y.|s@| |�� ksV|rZ| d�|�� �krZdS W q* tjk
rt w*Y q*X q*W dS )a�
Check that a file in path is running.
You can get false-postive if parameter `strict_match` == False, process is
not running, but someone on server open file by path `process_file_path`
in an editor
:param process_file_path: path to a file which is run
:param strict_match: we use parameter `process_file_path` as full cmd line
with args for comparing if `strict_match` == True.
:return: True if it's running, False - is not,
zProcess file in path "z" does not exist�cmdline� TF) r r r] rt �psutilZ process_iterr� �joinZ
NoSuchProcess)r� r� Zprocessr r r �process_is_running� s r� )�dtrP c C s0 t | tjtjf�s$tdt| �� ���t| �� S )z�
Getting string representation of weekday from datetime.datetime or datetime.date.
Returns shortened version of weekday from WEEK_DAYS.
zFRequire object of type datetime.datetime or datetime.date, but passed )�
isinstance�datetime�date� TypeError�type� WEEK_DAYSZweekday)r� r r r � get_weekday� s r� )� config_path�apache_module_name�
param_name�defaultrP c
s� d|� d�}g }t | �}d}x>|D ]6}|�� }||kr<d}q"|rJ|dkrJP |r"|�|� q"W tt� dd|d��} � fdd�| D �}
|
s�|d k r�|d
fS |
s�|d kr�d d |� d
| � �fS |
d �d�} t| d �} | d
fS )a
Helper to parse httpd config for details about mpm module used
:param config_path: path for configuration file with modules
:param apache_module_name: expected mpm module. Can be `event`,
`worker`, `prefork`
:param param_name: name of parameter to find
:param default: default value for parameter, if there won't be record
:return: tuple with param value and text result of operation
Example of config file content:
<IfModule mpm_prefork_module>
.................
MaxRequestWorkers 450
</IfModule>
--
<IfModule mpm_worker_module>
.................
MaxRequestWorkers 300
</IfModule>
--
<IfModule mpm_event_module>
.................
MaxRequestWorkers 2048
</IfModule>
z<IfModule mpm_z_module>FTz </IfModule>)rI rH rJ c s" g | ]}|� � �� �r|� � �qS r )r` rA )r+ Z directive)r� r r r. s z/find_module_param_in_config.<locals>.<listcomp>NZOKr z.MaxRequestWorkers directive not found for mpm_z_module module in r3 r� )r% r` �append�listrL ru r{ )
r� r� r� r� Zif_module_lineZ
section_linesZ mpm_linesZis_section_foundr- Zgrep_result_listZmrw_list�partsZmax_request_workersr )r� r �find_module_param_in_config� s:
r� c
C sj d} t j�| �sdS y6t| d��}|�� �� }W dQ R X |�dd�\}}W n ttt fk
rd dS X |S )zp
Return kmodlve module's version.
Content of '/sys/module/kmodlve/version' looks like '2.0-30.el8'.
z/sys/module/kmodlve/versionrs r Nr� r� )
r r r r! rf r` �rsplitr rV r| )Zkmodlve_module_file_pathr$ �moduleZmodule_version�_r r r �get_kmodlve_module_version/ s r� c C s8 ddi} t � }|| krdS | | }t� }||kr4dS dS )a
Find out if system has version of the kernel
(according to kmodlve module's version)
where fs.proc_can_see_other_uid and hidepid options are synchronized.
They are only synchronized if kmodlve module's version
is equal to version in synced_kmodlve_versions.
ri z2.0-30FT)rq r� )Zsynced_kmodlve_versionsZ
cl_versionZsynced_versionZcurrent_versionr r r �)proc_can_see_other_uid_and_hidepid_synced@ s r� )� pid_filenamerP c
C sZ y6t | d��"}t|�� �� �}t�|d� W dQ R X W n tttfk
rT d}Y nX |S )z�
Detrmines working daemon process pid
:param pid_filename: PID filename
:return: PID from file or None if error (file not found, etc)
r r N) r! r{ rf r` r rx r rV r| )r� �pfrw r r r �get_process_pidS s
r� )r� c C s* t | d��}|�t�� � � W dQ R X dS )z
Writes pid file
zw+N)r! �writer �getpid)r� r� r r r �write_pid_filec s r� c C s, yt �| � W n ttfk
r& Y nX dS )z
Remove PID file
N)r �remover rV )r� r r r �remove_pid_filek s r� c s � �fdd�}|S )a
Set user's real uid and gid to specified ones.
Checking equality of real and effective uids is needed
because this function may be used by root
with effective uid dropped to user's uid.
In that case it is needed to set effective uid back to 0 first.
c s: t �� } t �� }| |kr"t �| � t �� � t ��� d S )N)r �getuidr4 �seteuid�setgid�setuid)Zreal_uidZeff_uid)�gidr� r r �func~ s
zdemote.<locals>.funcr )r� r� r� r )r� r� r �demoteu s
r� )�dirpathrP c C sv t j�| �s td| � d���dd| g}t|�}y |�d�d }|�d�d }W n" tk
rp td |� ���Y nX |S )
zK
Get mount point for dirpath directory from output of `df` utility
z Directory "z" does not existz/bin/dfz-hr) r� r� r3 z)Utility "df" returned unexpected output:
)r r �isdirr r ru rW )r� Z fs_info_cmdZfs_infoZmountpoint_infoZ
mounted_onr r r �get_mount_point� s
r� )N)NFTFN)N)UZ
__future__r r r r� r� rC r� r r; r5 r^ ro r� � functoolsr Z configparserr r �typingr r r
r r r
r� Zlxmlr r� Zclcommon.lib.cleditionr Zclcommon.utils_cmdr r r r rN r� r r r% r( r1 r> r? rL rO r� rX rd �boolrh rq rv r{ ry r} r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r �<module> s�
,,*&
"'
I
Mini Shell