Any way to execute a piped command in Python using subprocess module, without using shell=True?

Question

I want to run a piped command line linux/bash command from Python, which first tars files, and then splits the tar file. The command would look like something this in bash: ``` > tar -cvf - path_to_archive/* | split -b 20m -d -a 5 - "archive.tar.split" ``` I know that I could execute it using subprocess, by settings shell=True, and submitting the whole command as a string, like so: ``` import subprocess subprocess.call("tar -cvf - path_to_archive/* | split -b 20m -d -a 5 - 'archive.tar.split'", shell=True) ``` ...but for security reasons I would like to find a way to skip the "shell=True" part, (which takes a list of strings rather than a full command line string, and which can not handle the pipe char correctly). Is there any solution for this in Python? I.e., is it possible to set up linked pipes somehow, or some other solution?

Accepted Answer

tar can split itself:

```
tar -L 1000000 -F name-script.sh cf split.tar largefile1 largefile2 ...
```

name-script.sh

```
#!/bin/bash
echo "${TAR_ARCHIVE/_part*.tar/}"_part"${TAR_VOLUME}".tar >&"${TAR_FD}"
```

To re-assemble

```
tar -M -F name-script.sh cf split.tar
```

Add this to your python program.

Any way to execute a piped command in Python using subprocess module, without using shell=True?

Solution

Problem