Sys Admin Magazine (p1 of 16)

   [logo_cmp_black.gif]
   [Type=count&AdID=50446&FlightID=31994&TargetID=2715&Segments=1411,1462
   ,1628,3158,3448,3977,4875&Targets=1215,2715,2878&Values=34,46,51,63,77
   ,80,92,101,140,203,442,646,944,945,963,1104,1184,1388,1405,1426,1431,1
   736,1766,1785,1944,1970,2310,2352&RawValues=&random=cjRkbtk,baRdiupcea
   imw]
   [logo_sa_new.jpg] [spacer_319cce.gif]
   ____________________ Search
     [Jump to:_________]
   [spacer_999999.gif]
   [spacer_999999.gif]
   January 2005
   [Type=count&AdID=50783&FlightID=32184&TargetID=2587&Segments=1411,3035
   ,3448,4875&Targets=2587,2878&Values=34,46,51,63,77,80,92,101,140,290,4
   42,646,918,944,945,963,1184,1388,1405,1426,1431,1736,1766,1785,1944,19
   70,2310,2352&RawValues=&random=dfnKozk,baRdiupceaimr]

Feature Article

(NORMAL LINK)   Use right-arrow or  to activate.
  Arrow keys: Up and Down to move.  Right to follow a link; Left to go back.
 H)elp O)ptions P)rint G)o M)ain screen Q)uit /=search [delete]=history list

                                                      Sys Admin Magazine (1/10)

[IMG]                           _____________________           [ Search ]


 January 2005                                              Current Issue

                    Feature Article                       [IMG]
                                                          Table of contents
 Open Source Anti-Virus for the Whole Network: ClamAV     Buy this issue.
 * James Mikusi
                                                           Unix Review Spotlight
 Mikusi provides an overview of the ClamAV anti-virus
 tool, which filters any given input and outputs a        Changes to the CIW
 basic summary stating whether a virus was detected.      Associate Certificatio
                                                          Exam
                        Columns                           The CIW (Certified
                                                          Internet Webmaster)
 Checking Your Bookmarks * Randal L. Schwartz             Foundation exam has
                                                          recently upgraded to
 Questions and Answers * Amy Rich                         version 5. This
                                                          vendor-neutral exam is
 -------------------------------------------------        at the core of all the
http://www.samag.com/

$ websnarf 'http://docs.sun.com/app/docs/doc/806-2221-10/6jbf1novc?a=view'
Snarfing http://docs.sun.com/app/docs/doc/806-2221-10/6jbf1novc?a=view...to docs.sun.com: Solaris 8 Sun Hardware Platform Guide.txt
$ cat 'docs.sun.com: Solaris 8 Sun Hardware Platform Guide.txt'
http://docs.sun.com/app/docs/doc/806-2221-10/6jbf1novc?a=view

   sun.com       How To Buy  |  My Sun  |  Worldwide Sites  |  Search sun.com

   Sun Microsystems Logo  [IMG]Products and          [IMG]Support and
                          Services                   Training


   docs.sun.com - Sun Product Documentation
...
   Table 1-1 Platform Names for Sun Systems

   +------------------------------------------------------------------------+
   | System                    | Platform Name            | Platform Group  |
   |---------------------------+--------------------------+-----------------|
   | SPARCclassic              | SUNW,SPARCclassic        | sun4m           |
   |---------------------------+--------------------------+-----------------|
   | SPARCstation LX           | SUNW,SPARCstation-LX     | sun4m           |
   |---------------------------+--------------------------+-----------------|
   | SPARCstation LX+          | SUNW,SPARCstation-LX+    | sun4m           |
   |---------------------------+--------------------------+-----------------|
   | SPARCstation 4            | SUNW,SPARCstation-4      | sun4m           |
   |---------------------------+--------------------------+-----------------|
   | SPARCstation 5            | SUNW,SPARCstation-5      | sun4m           |
   |---------------------------+--------------------------+-----------------|

#!/bin/sh

if [ $# -lt 1 ]; then
        echo "Usage: `basename $0` url..." 1>&2
        exit 1
fi

for url in "$@"; do
	echo -n "Snarfing $url..." 1>&2
	title=`html_title "$url"`
	echo "to $title.txt" 1>&2
	echo "$url" > "$title.txt"
	echo >> "$title.txt"
	elinks -dump "$url" >> "$title.txt"
done

#!/usr/bin/perl -w
use strict;
use warnings;

use File::Basename;
use LWP::Simple;
use HTML::TokeParser;

my $program = basename $0;
my $url = shift or die "Usage: $program url\n";
my $html = get($url) or die "Can't retrieve $url\n";
my $p = HTML::TokeParser->new(\$html);

if ($p->get_tag("title")) {
	print $p->get_trimmed_text, "\n";
} else {
        print $url, "\n";
}

$ telnet www.freebsd.org 80
Trying 216.136.204.117...
Connected to www.freebsd.org (216.136.204.117).
Escape character is '^]'.
GET /
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
    "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

<html xmlns="http://www.w3.org/1999/xhtml">
  <head>
    <meta name="generator" content="HTML Tidy, see www.w3.org" />
    <meta http-equiv="Content-Type"
    content="text/html; charset=iso-8859-1" />

    <title>The FreeBSD Project</title></pre></small>
    <meta name="description" content="The FreeBSD Project" />
    <meta name="keywords"
    content="FreeBSD, BSD, UNIX, Support, Gallery, Release, Application, Softwar
e, Handbook, FAQ, Tutorials, Bugs, CVS, CVSup, News, Commercial Vendors, homepage, CTM, Unix" />
...

use HTML::TokeParser;

my $parser = HTML::TokeParser->new($FILENAME)
	or die "Can't open $FILENAME: $!\n";
while (my $token = $parser->get_token( )) {
	my $type = $token->[0];
	if    ($type eq 'S')  { ... }   # start tag
	elsif ($type eq 'E')  { ... }   # end tag
	elsif ($type eq 'T')  { ... }   # text
	elsif ($type eq 'C')  { ... }   # comment
	elsif ($type eq 'D')  { ... }   # declaration
	elsif ($type eq 'PI') { ... }   # processing instruction
	else { die "$type isn't a valid HTML token type" }
}