Python tarfile slow than Linux command(Python tarfile 比 Linux 命令慢)
问题描述
我尝试了不同的方式来压缩文件夹.我的理解是 Python 内置模块总是比 subprocess.call("Linux command") 快.但我只是做了一些演示.tarfile 模块比 subprocess.call("tar") 慢.有人可以向我解释一下吗?
I tried the different way to zip folder.My understanding is that Python built-in module always faster than subprocess.call("Linux command"). But I just did some demo. The tarfile module is slow than subprocess.call("tar").Can someone explain it to me?
#!/usr/bin/python
import os
import time
import tarfile
import subprocess
tStart1 = time.time()
TestFolder = ["Jack", "Robin"]
for folder in TestFolder:
name = "/mnt/ShareDrive/Share/ExistingUsers/"+folder
path = "/mnt/TEST2/"
tar = tarfile.open(path+folder+".tar.gz", "w:gz")
tar.add(name)
tar.close()
tEnd1 = time.time()
time.sleep(2)
tStart2 = time.time()
for folder in TestFolder:
path = "/mnt/TEST1/"
subprocess.call(["tar", "zcvf", path+folder+".tar.gz", "-P", "/mnt/ShareDrive/Share/ExistingUsers/"+folder])
tEnd2 = time.time()
print "The module cost %f sec" % (tEnd1 - tStart1)
print "The subprocess cost %f sec" % (tEnd2 - tStart2)
tarfile 模块耗时 63 秒.子流程仅需 32 秒.
The tarfile module cost 63 sec. The subprocess cost only 32 sec.
两个文件夹的总大小为 433 MB
The total size of two folders is 433 MB
推荐答案
tar
是用 C 语言编写的.tarfile
模块是 tar 处理的纯 Python 实现.模块不可能比命令快.
tar
is written in C. The tarfile
module is a pure Python implementation of tar handling. There is no way that the module will be faster than the command.
这篇关于Python tarfile 比 Linux 命令慢的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持编程学习网!
本文标题为:Python tarfile 比 Linux 命令慢


基础教程推荐
- 包装空间模型 2022-01-01
- 求两个直方图的卷积 2022-01-01
- PANDA VALUE_COUNTS包含GROUP BY之前的所有值 2022-01-01
- 在Python中从Azure BLOB存储中读取文件 2022-01-01
- 无法导入 Pytorch [WinError 126] 找不到指定的模块 2022-01-01
- 在同一图形上绘制Bokeh的烛台和音量条 2022-01-01
- 使用大型矩阵时禁止 Pycharm 输出中的自动换行符 2022-01-01
- PermissionError: pip 从 8.1.1 升级到 8.1.2 2022-01-01
- Plotly:如何设置绘图图形的样式,使其不显示缺失日期的间隙? 2022-01-01
- 修改列表中的数据帧不起作用 2022-01-01