| | 146 | |
| | 147 | |
| | 148 | = First experiences with slow data insertion = |
| | 149 | |
| | 150 | In about 8h I only managed to insert 262MB of data. While neither the python process, that was reading the data, nor the mysqld, that was writing the data comsumed 100% CPU load at any time. Not sure why this is the case? |
| | 151 | Mybe the stuff was io blocked. |
| | 152 | |
| | 153 | --> python script is 40...500 times faster when not inserting the data into the DB, but just reading... so input side is not io blocked. |
| | 154 | |
| | 155 | apparently one can improve the situation a bit by using bulk inserta, but one must also stay below the maximum paket size |
