File patterns This is to download multiple files of the same pattern form different directory. In ftp.pyclass.com there are directories organized in year, and within each year there are gunzip files that has this pattern stationId-Year on this example I will be downloading the gunzip files which has a station id 010010-99999, between the year … Continue reading [python]Download multiple files from different directories from ftp server
You may wish to enroll the course by Ardit Sulce, I will not reveal the username and password on his ftp.pyclass.com, to be fair to him in order to use his resource for practice and learning data science you got to enroll to his course. The code presented here has 5 parts: security.crypto, for encrypting … Continue reading [python]Download files with FTP client with multithreading
To compare between with and without threading, there are three routers from R1 to R3, the task is to save the show version on each router to all.txt. Do the tasks without threading The script runs sequentially on each device, and the total time is 15seconds. Do the tasks with threading The time taken to … Continue reading [python]Comparing executed time between with and without threading
On previous post about threading, there is no worry of data corruption as each fetch and write is to different destination and write to different file respectively. What if the requirement is to append all data fetched from multiple websites and write them into a single file? There will be race condition which the same … Continue reading [python]Threading, acquiring and releasing lock to access shared resource.
This is a revision for myself on threading. To start threading in python a package threading has to be imported. The dictionary for a list of websites, the script is to save the body of the website into a file. For each key in urls, a thread object is created. The thread object takes in … Continue reading [python]Threading
Background This is an upgrade scripts to check for open ports on every addresses found in subnets. The upgrade uses Processpoolexecutor, a minor re-write uses the processpoolexecutor and theadpoolexecutor together. network_discovery.py - obtains directly connected subnets scanner.py This script does the port scanning based on the subnets obtained from network_discovery.py. start_now.py - main script to … Continue reading [python]Multiprocess and multithreading for port scan version 3
Background I have noticed that previously my script is a one to one, meaning the scripts I wrote do specific things to a single target, this will be very impractical if the targets are more than one and requires to do the same function. Hence I am exploring into threading. Threading My first use of … Continue reading [python]Multithreading to scan for port status