Today I stumbled over http://scrapy.org/ while searching for an OpenSource website crawler. Its an interesting crawling and scraping framework for Python. It looks very convenient and easy to use. The most interesting feature seems to be the possibility to select website elements (f.e. hyperlinks) via CSS-selectors. In any case I’ll give it a try.
Recently I brought a mp3 player that wasn’t able to shuffle the track through all folders. That’s why I had to bring all tracks to the root directory of the player (flatten directory structure). I did it with the following command, that flattens the whole structure by searching all files in the structure and copying […]
Sometimes I had problems to connect to a server via public key authentication. In most cases I could solve them by setting up the right permissions for the file and path of the authorized_keys file. This can be done as shown below: $> chmod 700 $HOME/.ssh $> chmod 600 $HOME/.ssh/authorized_keys $> chmod go-w $HOME $HOME/.ssh […]
To get information about the currently connected user and more MySQL status information, you can call the following command if you are already logged in: mysql> STATUS; This will give you an output like that: ————– mysql Ver 14.14 Distrib 5.1.73, for redhat-linux-gnu (x86_64) using readline 5.1 Connection id: 1044395 Current database: Current user: niceguy@localhost SSL: […]
This simple bash script is able to backup all given files and folders to a backup destination. I use it to backup all my Raspberry Pis, Banana Pis and also my notebook to my Synology NAS. #!/bin/bash # Lockfilecheck for race condition protection exec 9>.backupLockFile if ! flock -n 9 ; then echo “Another instance is […]
To crate a UTF-8 database: CREATE DATABASE sns_typo3 DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
To reinstall Magtento with the installation wizard you have to: delete app/etc/local.xml clear cache $> rm -rf /path/to/mage/var/cache/* reload your shop frontend
To change the permissions of all files and / or folders insight the current folder recursively you can run one of the following command: $> sudo find . -type d -exec chmod 644 {} \; #all folders get 644 $> sudo find . -exec chmod g+r {} \; #all files and folders get group read rights […]
To change the ownership of all files and folders with a certain group and / or user insight the current folder recursively you can run the following command: $> sudo find . -group OLDGROUP -user OLDUSER -exec chown NEWUSER:NEWGROUP {} \; This way you can set the owning group and / or user.
It’s no big deal to comment out a line in YAML. Just put a sharp (#) as the first character of that line. fileSync: typo3_user_upload: #rsync_params: ‘–delete -avhHxS’ #source: ‘shared/typomage/fileadmin/user_upload’ #target: ‘shared/typomage/fileadmin/user_upload’ typo3_redaktion: rsync_params: ‘–delete -avhHxS’ source: ‘shared/typomage/fileadmin/redaktion’ target: ‘shared/typomage/fileadmin/redaktion’ # magento_media: # rsync_params: ‘–delete -avhHxS’ # source: ‘shared/typomage/media/catalog/product’ # target: ‘shared/typomage/media/catalog/product’ As you can see […]
