php details several ways to read file contents
- 2020-06-19 09:56:20
- OfStack
Example code 1: Get the content get with file_get_contents
<?php
$url='http://www.baidu.com/';
$html=file_get_contents($url);
//print_r($http_response_header);
ec($html);
printhr();
printarr($http_response_header);
printhr();
?>
Example code 2: Open url with fopen and get the content as get
<?
$fp=fopen($url,'r');
printarr(stream_get_meta_data($fp));
printhr();
while(!feof($fp)){
$result.=fgets($fp,1024);
}
echo"url body:$result";
printhr();
fclose($fp);
?>
Example code 3: Use the file_get_contents function to get url as post
<?php
$data=array('foo'=>'bar');
$data=http_build_query($data);
$opts=array(
'http'=>array(
'method'=>'POST',
'header'=>"Content-type: application/x-www-form-urlencoded\r\n".
"Content-Length: ".strlen($data)."\r\n",
'content'=>$data
),
);
$context=stream_context_create($opts);
$html=file_get_contents('http://localhost/e/admin/test.html',false,$context);
echo$html;
?>
Example code 4: Open url with the fsockopen function and get the complete data in get fashion, including header and body
<?
functionget_url($url,$cookie=false){
$url=parse_url($url);
$query=$url[path]."?".$url[query];
ec("Query:".$query);
$fp=fsockopen($url[host],$url[port]?$url[port]:80,$errno,$errstr,30);
if(!$fp){
returnfalse;
}else{
$request="GET$queryHTTP/1.1\r\n";
$request.="Host:$url[host]\r\n";
$request.="Connection: Close\r\n";
if($cookie)$request.="Cookie:$cookie\n";
$request.="\r\n";
fwrite($fp,$request);
while(!@feof($fp)){
$result.=@fgets($fp,1024);
}
fclose($fp);
return$result;
}
}
// To obtain url the html Part, get rid of header
functionGetUrlHTML($url,$cookie=false){
$rowdata=get_url($url,$cookie);
if($rowdata)
{
$body=stristr($rowdata,"\r\n\r\n");
$body=substr($body,4,strlen($body));
return$body;
}
returnfalse;
}
?>
Example code 5: Open url with the fsockopen function and get the complete data, including header and body, as POST
<?
functionHTTP_Post($URL,$data,$cookie,$referrer=""){
// parsing the given URL
$URL_Info=parse_url($URL);
// Building referrer
if($referrer=="")// if not given use this script. as referrer
$referrer="111";
// making string from $data
foreach($dataas$key=>$value)
$values[]="$key=".urlencode($value);
$data_string=implode("&",$values);
// Find out which port is needed - if not given use standard (=80)
if(!isset($URL_Info["port"]))
$URL_Info["port"]=80;
// building POST-request:
$request.="POST ".$URL_Info["path"]." HTTP/1.1\n";
$request.="Host: ".$URL_Info["host"]."\n";
$request.="Referer:$referer\n";
$request.="Content-type: application/x-www-form-urlencoded\n";
$request.="Content-length: ".strlen($data_string)."\n";
$request.="Connection: close\n";
$request.="Cookie:$cookie\n";
$request.="\n";
$request.=$data_string."\n";
$fp=fsockopen($URL_Info["host"],$URL_Info["port"]);
fputs($fp,$request);
while(!feof($fp)){
$result.=fgets($fp,1024);
}
fclose($fp);
return$result;
}
printhr();
?>
Example code 6: Before using the curl library, you may want to check 1 php.ini to see if the curl extension has been opened
<?
$ch = curl_init();
$timeout = 5;
curl_setopt ($ch, CURLOPT_URL, 'http://www.baidu.com/');
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, $timeout);
$file_contents = curl_exec($ch);
curl_close($ch);
echo $file_contents;
?>
About the curl library:
curl http official website: / / curl haxx. se /
curl is a file transfer tool using URL syntax, supporting FTP, FTPS, HTTP HTPPS SFTP TFTP TELNET DICT FILE and LDAP. curl supports SSL certificates, HTTP POST, HTTP PUT, FTP uploads, kerberos, HTT based uploads, proxies, cookie, user + password certificates, file transfer recovery, http proxy channels and a host of other useful tips
<?
functionprintarr(array$arr)
{
echo"<br> Row field count: ".count($arr)."<br>";
foreach($arras$key=>$value)
{
echo"$key=$value <br>";
}
}
?>
======================================================
PHP code to fetch data from remote sites
Now there may be a lot of program fans will encounter the same question, is how to crawl other websites like the search engine HTML code, and then the code collection into their own useful data! Let me introduce 1 simple example today.
An example of Ⅰ. Grab the remote page title:
Here is the code snippet:
<?php
/*
+-------------------------------------------------------------
+ Code to grab the title of a web page , Copy this code snippet directly , Save as .php File execution is ok .
+-------------------------------------------------------------
*/
error_reporting(7);
$file = fopen ("http://www.dnsing.com/", "r");
if (!$file) {
echo "<font color=red>Unable to open remote file.</font>\n";
exit;
}
while (!feof ($file)) {
$line = fgets ($file, 1024);
if (eregi ("<title>(.*)</title>", $line, $out)) {
$title = $out[1];
echo "".$title."";
break;
}
}
fclose($file);
//End
?>
Ⅱ. Grab the remote web HTML examples of code:
Here is the code snippet:
<? php
/*
+----------------
+DNSing Sprider
+----------------
*/
$fp = fsockopen("www.dnsing.com", 80, $errno, $errstr, 30);
if (!$fp) {
echo "$errstr ($errno)<br/>\n";
} else {
$out = "GET / HTTP/1.1\r\n";
$out .= "Host:www.dnsing.com\r\n";
$out .= "Connection: Close \r\n\r\n";
fputs($fp, $out);
while (!feof($fp)) {
echo fgets($fp, 128);
}
fclose($fp);
}
//End
?>
Above two code snippets are directly Copy to run back to know the effect, the above example is just a prototype to grab web data, to make it more suitable for your own use, the situation varies. So, here you program enthusiasts take a good look at 1.
===============================
A slightly more interesting function is get_content_by_socket(), get_url(), get_content_url(), get_content_object, which might give you some ideas.
<?php
// Get all the content url Save to file
function get_index($save_file, $prefix="index_"){
$count = 68;
$i = 1;
if (file_exists($save_file)) @unlink($save_file);
$fp = fopen($save_file, "a+") or die("Open ". $save_file ." failed");
while($i<$count){
$url = $prefix . $i .".htm";
echo "Get ". $url ."...";
$url_str = get_content_url(get_url($url));
echo " OK\n";
fwrite($fp, $url_str);
++$i;
}
fclose($fp);
}
// Gets the target multimedia object
function get_object($url_file, $save_file, $split="|--:**:--|"){
if (!file_exists($url_file)) die($url_file ." not exist");
$file_arr = file($url_file);
if (!is_array($file_arr) || empty($file_arr)) die($url_file ." not content");
$url_arr = array_unique($file_arr);
if (file_exists($save_file)) @unlink($save_file);
$fp = fopen($save_file, "a+") or die("Open save file ". $save_file ." failed");
foreach($url_arr as $url){
if (empty($url)) continue;
echo "Get ". $url ."...";
$html_str = get_url($url);
echo $html_str;
echo $url;
exit;
$obj_str = get_content_object($html_str);
echo " OK\n";
fwrite($fp, $obj_str);
}
fclose($fp);
}
// Traverse the directory to get the file contents
function get_dir($save_file, $dir){
$dp = opendir($dir);
if (file_exists($save_file)) @unlink($save_file);
$fp = fopen($save_file, "a+") or die("Open save file ". $save_file ." failed");
while(($file = readdir($dp)) != false){
if ($file!="." && $file!=".."){
echo "Read file ". $file ."...";
$file_content = file_get_contents($dir . $file);
$obj_str = get_content_object($file_content);
echo " OK\n";
fwrite($fp, $obj_str);
}
}
fclose($fp);
}
// Access to specify url content
function get_url($url){
$reg = '/^http:\/\/[^\/].+$/';
if (!preg_match($reg, $url)) die($url ." invalid");
$fp = fopen($url, "r") or die("Open url: ". $url ." failed.");
while($fc = fread($fp, 8192)){
$content .= $fc;
}
fclose($fp);
if (empty($content)){
die("Get url: ". $url ." content failed.");
}
return $content;
}
// use socket Get the specified page
function get_content_by_socket($url, $host){
$fp = fsockopen($host, 80) or die("Open ". $url ." failed");
$header = "GET /".$url ." HTTP/1.1\r\n";
$header .= "Accept: */*\r\n";
$header .= "Accept-Language: zh-cn\r\n";
$header .= "Accept-Encoding: gzip, deflate\r\n";
$header .= "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; InfoPath.1; .NET CLR 2.0.50727)\r\n";
$header .= "Host: ". $host ."\r\n";
$header .= "Connection: Keep-Alive\r\n";
//$header .= "Cookie: cnzz02=2; rtime=1; ltime=1148456424859; cnzz_eid=56601755-\r\n\r\n";
$header .= "Connection: Close\r\n\r\n";
fwrite($fp, $header);
while (!feof($fp)) {
$contents .= fgets($fp, 8192);
}
fclose($fp);
return $contents;
}
// Gets the value in the specified content url
function get_content_url($host_url, $file_contents){
//$reg = '/^(#|javascript.*?|ftp:\/\/.+|http:\/\/.+|.*?href.*?|play.*?|index.*?|.*?asp)+$/i';
//$reg = '/^(down.*?\.html|\d+_\d+\.htm.*?)$/i';
$rex = "/([hH][rR][eE][Ff])\s*=\s*['\"]*([^>'\"\s]+)[\"'>]*\s*/i";
$reg = '/^(down.*?\.html)$/i';
preg_match_all ($rex, $file_contents, $r);
$result = ""; //array();
foreach($r as $c){
if (is_array($c)){
foreach($c as $d){
if (preg_match($reg, $d)){ $result .= $host_url . $d."\n"; }
}
}
}
return $result;
}
// Gets the multimedia file in the specified content
function get_content_object($str, $split="|--:**:--|"){
$regx = "/href\s*=\s*['\"]*([^>'\"\s]+)[\"'>]*\s*(<b>.*?<\/b>)/i";
preg_match_all($regx, $str, $result);
if (count($result) == 3){
$result[2] = str_replace("<b> Multimedia: ", "", $result[2]);
$result[2] = str_replace("</b>", "", $result[2]);
$result = $result[1][0] . $split .$result[2][0] . "\n";
}
return $result;
}
?>
======================================================
When multiple IP correspond to 1 domain name, PHP gets remote web page content
fgc is simply read in, encapsulating the 1 - cut operation
fopen also does some encapsulation, but requires you to loop through all the data.
fsockopen This is the socket operation for straight boards.
If you just read 1 html page, fgc is better.
If the company accesses the Internet through a firewall, the 1-like file_get_content function will not work. Of course, it is possible to write http requests directly to proxy with 1 socket operation, but it is cumbersome.
If you can confirm that the file is small, you can choose either of the above methods fopen,join(",file($file)); . For example, if you only work with files smaller than 1k, it's better to use file_get_contents.
If you determine that the file is large, or if you cannot determine the size of the file, then it is best to use a file stream. There is no significant difference between fopen1 1K files and fopen1 1G files. If the content is long, it will take longer to read rather than let the script die.
----------------------------------------------------
http://www.phpcake.cn/archives/tag/fsockopen
PHP has many ways to obtain remote web content, such as using the built-in file_get_contents, fopen and other functions.
<?
$fp=fopen($url,'r');
printarr(stream_get_meta_data($fp));
printhr();
while(!feof($fp)){
$result.=fgets($fp,1024);
}
echo"url body:$result";
printhr();
fclose($fp);
?>
However, in load balancing such as DNS polling, there may be multiple servers and multiple IP for the same domain name. Assuming blog. s135. com DNS parsed into 72.249.146.213, 72.249.146.214, 72.249.146.2153 IP, every time the user access blog. s135. com, system will be according to the corresponding algorithm of load balance to visit one of these servers.
Last week, while working on a video project, I encountered a requirement of type 1: I needed to access one PHP interface program on each server in turn (assuming abc.php) to check the transmission status of that server.
At this moment cannot directly use file_get_contents access http: / / blog s135. com/abc php, because it May 1 straight repeat visit a 1 server.
And use, in turn, access http: / / 72.249.146.213 abc php, http: / / 72.249.146.214 abc php, http: / / 72.249.146.215 abc php method, in this 3 servers Web Server equipped with multiple virtual host, is no good.
Setting local hosts won't work either, because hosts can't set multiple IP domains with one domain name.
It is only through PHP and HTTP agreement: visit abc. php, adding blog in header head. s135. com domain name. So I wrote the following PHP function:
<?php
/************************
* Function purpose: same as 1 Multiple domain names IP Gets the remote web page content of the specified server
* Parameter description:
* $ip The server's IP address
* $host The server's host The name of the
* $url The server's URL Address (excluding domain name)
* The return value:
* Access to remote web page content
* false Failed to access the remote page
************************/
function HttpVisit($ip, $host, $url)
{
$errstr = '';
$errno = '';
$fp = fsockopen ($ip, 80, $errno, $errstr, 90);
if (!$fp)
{
return false;
}
else
{
$out = "GET {$url} HTTP/1.1\r\n";
$out .= "Host:{$host}\r\n";
$out .= "Connection: close\r\n\r\n";
fputs ($fp, $out);
while($line = fread($fp, 4096)){
$response .= $line;
}
fclose( $fp );
// To get rid of Header Header information
$pos = strpos($response, "\r\n\r\n");
$response = substr($response, $pos + 4);
return $response;
}
}
// Call method:
$server_info1 = HttpVisit("72.249.146.213", "blog.s135.com", "/abc.php");
$server_info2 = HttpVisit("72.249.146.214", "blog.s135.com", "/abc.php");
$server_info3 = HttpVisit("72.249.146.215", "blog.s135.com", "/abc.php");
?>