Run Python Scripts In Parallel And Wait For All To Finish Before Executing More Parallel Scripts

I need to execute my Python scripts in parallel so I use the following batch file for it: start python C:\myfolder\1.py start python C:\myfolder\2.py start python C:\myfolder\3.py

Solution 1:

You can easily do this in python without using windows batch commands.

You can use the subprocess library to run external scripts simultaneously and then wait for them all to complete.

processes = []
scripts = [
    r'C:\myfolder\1.py',
    r'C:\myfolder\2.py',
    r'C:\myfolder\3.py',
]
for script in scripts:
    p = subprocess.Popen(['python', script])
    processes.append(p)

for p in processes:
    p.wait()

# Run other processes here

Solution 2:

I think it should work like this:

(
    start python C:\myfolder\1.py
    start python C:\myfolder\2.py
    start python C:\myfolder\3.py
) | pause

For an explanation see this answer.