mysql automatically synchronizes memcached efficiency notes using UDF

  • 2020-05-12 06:17:22
  • OfStack

mysql USES mysql-udf-http efficiency test notes. This time, instead of using the rest architecture, libmemcached and memcached_functions_mysql are used. The test version is:

libmemcached-0.34.tar.gz and memcached_functions_mysql.tar.gz have problems with other versions. I have installed and tested the versions with problems as follows:

 
memcached_functions_mysql-1.1 In:  
libmemcached-0.49\libmemcached-0.48\libmemcached-0.47\libmemcached-0.30\libmemcached-0.43\\libmemcached-0.42\ 
 There is an error in the following installation  
memcached_functions_mysql-0.10 In:  
libmemcached-0.42\ There is an error in the following installation  
memcached_functions_mysql-0.8 In:  
libmemcached-0.49\libmemcached-0.48\libmemcached-0.47\libmemcached-0.44\libmemcached-0.43\ 
\libmemcached-0.42\ There is an error in the following installation  

MySQL test version: 5.1.55, operating system Centos5.4 64bit, memory 2G

Install libmemcached-0.34 and memcached_functions_mysql-0.9,
 
[root@sunss24 libmemcached-0.34]#./configure \ 
--with-memcached=/home/memcache/bin/memcached 
[root@sunss24 libmemcached-0. 34]# make 
[root@sunss24 libmemcached-0. 34]# make install 
 Run again 1 Under the memstat "Is considered a success  
[root@sunss24 ~]# ln -s /usr/local/lib/libmemcached.so.3 /usr/lib/ 
[root@sunss24 ~]# cd memcached_functions_mysql-0.9 
[root@sunss24 memcached_functions_mysql-0.9]# ./configure \ 
--with-mysql=/usr/local/mysql/bin/mysql_config \ 
--libdir=/usr/local/mysql/lib/ 
[root@sunss memcached_functions_mysql-0.9]# make && make install 

Load UDFs into MySQL after installation:
 
mysql> show variables like "%plugin%"; 
+---------------+-----------------------------------+ 
| Variable_name | Value | 
+---------------+-----------------------------------+ 
| plugin_dir | /usr/local/mysql/lib/mysql/plugin | 
+---------------+-----------------------------------+ 
1 row in set (0.00 sec) 

[root@sunss ~]# find / -name "libmemcached_functions_mysql.so" 
/usr/local/mysql/lib/libmemcached_functions_mysql.so 
/root/memcached_functions_mysql-0.9/src/.libs/libmemcached_functions_mysql.so 
You have new mail in /var/spool/mail/root 
[root@sunss ~]# cp /usr/local/mysql/lib/libmemcached_functions_mysql.so /usr/local/mysql/lib/mysql/plugin/ 
[root@sunss ~]# cd memcached_functions_mysql-0.9/ 
[root@sunss ~]#cd sql/ 
mysql> source install_functions.sql; 

View various versions:
 
mysql> select memc_udf_version(); 
+--------------------+ 
| memc_udf_version() | 
+--------------------+ 
| 0.9 | 
+--------------------+ 
1 row in set (0.00 sec) 

mysql> select memc_libmemcached_version(); 
+-----------------------------+ 
| memc_libmemcached_version() | 
+-----------------------------+ 
| 0.34 | 
+-----------------------------+ 
1 row in set (0.00 sec) 

mysql> 

Problems encountered:
 
No package 'libmemcached' found 

Consider adjusting the PKG_CONFIG_PATH environment variable if you 
installed software in a non-standard prefix. 

Alternatively, you may set the environment variables DEPS_CFLAGS 
and DEPS_LIBS to avoid the need to call pkg-config. 
See the pkg-config man page for more details. 
 Solutions:  
[root@sunss24 memcached_functions_mysql-0.9]# whereis pkgconfig 
[root@sunss24 memcached_functions_mysql-0.9]# export \ 
PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:/usr/lib/pkgconfig 

Export all memcache content:
Use: memcached - hack zip
Efficiency test:
Insert:
 
<?php 
include_once("gettime.php"); 
$btime = getmicrotime(); 
$i = 0; 
$mem = new Memcache(); 
$mem->addServer('192.168.0.10', 11212); 
$local_db = mysql_connect("192.168.0.208", "sunss", "123456"); 
if(!$local_db) 
{ 
die('Could not connect: '.mysql_error()); 
} 
$local_db_sel = mysql_select_db("test", $local_db); 
mysql_query("set names utf8", $local_db); 
while ( $i < 1000) { 
$re_sql = "insert into urls (id,url) values ($i, 'www.gongchang.com')"; 
$res = mysql_query($re_sql, $local_db); 
$i++; 
} 
mysql_close($local_db); 
$etime = getmicrotime(); 
$runTime = round($etime - $btime, 4); 
echo "runTime: ".$runTime."\r\n"; 
?> 

1000 pieces, insert time: runTime: 1.4072
Delete:
 
<?php 
include_once("gettime.php"); 
$btime = getmicrotime(); 
$i = 0; 
$mem = new Memcache(); 
$mem->addServer('192.168.0.10', 11212); 
$local_db = mysql_connect("192.168.0.208", "sunss", "123456"); 
if(!$local_db) 
{ 
die('Could not connect: '.mysql_error()); 
} 
$local_db_sel = mysql_select_db("test", $local_db); 
mysql_query("set names utf8", $local_db); 
while ( $i < 1000) { 
//$re_sql = "insert into urls (id,url) values ($i, 'www.gongchang.com')"; 
$re_sql = "delete from urls where id=".$i; 
//echo "re_sql_1: ".$re_sql."\n"; 
$res = mysql_query($re_sql, $local_db); 
$i++; 
} 
mysql_close($local_db); 
$etime = getmicrotime(); 
$runTime = round($etime - $btime, 4); 
echo "runTime: ".$runTime."\r\n"; 
?> 

Delete 1000, run time: runTime: 1.5534
Update for
Conclusion: query records about 650 records per second, much faster than the previous mysql-udf-http

Related articles: