TECH.kulish.com » Linux http://tech.kulish.com Technical Goulash Thu, 01 Dec 2011 00:39:52 +0000 en hourly 1 http://wordpress.org/?v=3.3.1 Debian Squeeze 802.3ad http://tech.kulish.com/2011/11/30/debian-squeeze-802-3ad/ http://tech.kulish.com/2011/11/30/debian-squeeze-802-3ad/#comments Thu, 01 Dec 2011 00:12:38 +0000 Null http://tech.kulish.com/?p=416 Debian Lenny and Squeeze
2x Realtek 8169
1x Reaktek 8169, 1x nForce
Fisher-Price My First Managed Switch

Testing:
iptraf
cat /proc/net/bonding/bond0

[1]
mode=0 (balance-rr)
Round-robin policy: Transmit packets in sequential order from the first available slave through the last. This mode provides load balancing and fault tolerance.


mode=1 (active-backup)
One slave interface is active at any time. If one interface fails, another interface takes over the MAC address and becomes the active interface. Provides fault tolerance only. Doesn’t require special switch support.


mode=2 (balance-xor)
Tranmissions are balanced across the slave interfaces based on ((source MAC) XOR (dest MAC)) modula slave count. The same slave is selected for each destination MAC. Provides load balancing and fault tolerance.


mode=3 (broadcast)
Transmits everything on all slave interfaces. Provides fault tolerance.


mode=4 (802.3ad)
This is classic IEEE 802.3ad Dynamic link aggregation. This requires 802.3ad support in the switch and driver support for retrieving the speed and duplex of each slave.


mode=5 (balance-tlb)
Adaptive Transmit Load Balancing. Incoming traffic is received on the active slave only, outgoing traffic is distributed according to the current load on each slave. Doesn’t require special switch support.


mode=6 (balance-alb)
Adaptive Load Balancing – provides both transmit load balancing (TLB) and receive load balancing for IPv4 via ARP negotiation. Doesn’t require special switch support, but does require the ability to change the MAC address of a device while it is open.


[2]
miimon
Specifies the MII link monitoring frequency in milliseconds. This determines how often the link state of each slave is inspected for link failures. A value of zero disables MII link monitoring. A value of 100 is a good starting point. The use_carrier option, below, affects how the link state is determined. See the High Availability section for additional information. The default value is 0.


[3]
bond-downdelay 200 : Set the time, t0 200 milliseconds, to wait before disabling a slave after a link failure has been detected. This option is only valid for the bond-miimon.


bond-updelay 200 : Set the time, to 200 milliseconds, to wait before enabling a slave after a link recovery has been detected. This option is only valid for the bond-miimon.


[4]
J.A. Sullivan on the debian-user list writes:

There are a couple of issues in bonding which can bite the unsuspecting (as they did me!). Round robin will load balance across multiple
interfaces but can produce serious issues with managing out of order TCP
packets. Thus, the performance gain decreases dramatically with the
number of interfaces. In other words, 2 NICs in RR mode will not give 2x the performance nor 3 NICs 3x performance. I do not recall the exact
numbers off the top of my head but averages are something like:
2 NICs – 1.6x performance
3 NICs – 1.9x performance

The other modes (other than failover) eliminate the out of order TCP
problem but do so at a cost. All traffic for a single traffic flow goes
across a single path. The most common way to identify a single traffic
flow is matching source and destination MAC addresses. Some bonding algorithms allow matches on layer 3 or even layer 4 data but, if the switch through which they flow only supports MAC to MAC flow assignments, it will all devolve to matching MAC addresses anyway.

So what is the practical outcome using non-RR bonding? You have only one
combination of source and destination MAC address for each socket, e.g.,
if you are measuring a single FTP connection, there is only one
combination of source and destination MAC address. Thus, no matter how
many NICs you have, all the traffic will flow across one combination of
NICs. You will see no performance improvement.

In fact, depending on how the MAC addresses are advertised from the
systems with multiple NICs, all traffic between two systems may flow
across the same pair of NICs even if there are multiple, different
traffic streams.

On the other hand, if you are using bonding to provide a trunk carrying
traffic from many different source and destination MAC address
combinations, each separate stream will be limited to the maximum of the
individual NICs but the aggregate throughput should increase almost
linearly with the number of NICs. Hope that helps – John



Resources:
[1] http://www.howtoforge.com/nic-bonding-on-debian-lenny
[2] http://www.linuxfoundation.org/collaborate/workgroups/networking/bonding
[3] http://www.cyberciti.biz/tips/debian-ubuntu-teaming-aggregating-multiple-network-connections.html
[4] http://comments.gmane.org/gmane.linux.debian.user/405553

]]> http://tech.kulish.com/2011/11/30/debian-squeeze-802-3ad/feed/ 1 Apache to Nginx Migration http://tech.kulish.com/2011/11/19/apache-to-nginx-migration/ http://tech.kulish.com/2011/11/19/apache-to-nginx-migration/#comments Sat, 19 Nov 2011 17:20:25 +0000 Null http://tech.kulish.com/?p=352


Apache to Nginx Migration

Status update of the web engine migration.
All items are pending further testing.

Tech.kulish.com
Fully functional (including links to other/outside domains)


Cars.kulish.com
Theme issues but otherwise functional
I am currently looking at new themes for this site
Fully functional

Family.kulish.com
Fully functional

Gallery.kulish.com
Working except HTTPS redirects to HTTP because of this…


setConfig(‘baseUri’, ‘http://gallery.kulish.com/main.php’)


Webmail.kulish.com
Fully functional, permanent HTTPS redirect in place

Mediaserv.kulish.com
Fully functional

Monitoring
My monitoring solution is collecting data but display is broken.
HTTP links do not work, just reloads the overview regardless of URL
HTTPS links do not work, throws an error on every click


400 Bad Request
The plain HTTP request was sent to HTTPS port


Cloud
Fully functional, permanent HTTPS redirect in place

Benchmarks
Benchmarks reflect real world performance but I’ve ran it locally against both engines.
Command used: ab -n 1000 -c 5 http://tech.kulish.com/index.php


Short version.
APACHE:
Time taken for tests: 195.169 seconds
Requests per second: 5.12 [#/sec] (mean)


Connect: 0 0 2.8 0 90
Processing: 318 973 2219.7 595 27929
Waiting: 318 965 2209.7 591 27929
Total: 319 974 2219.9 595 27929


NGINX:
Time taken for tests: 109.310 seconds
Requests per second: 9.15 [#/sec] (mean)


Connect: 0 0 0.6 0 10
Processing: 280 546 80.1 543 1022
Waiting: 280 546 80.1 543 1022
Total: 280 546 80.0 543 1022


Long version.
APACHE:
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/


Benchmarking tech.kulish.com (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Completed 1000 requests
Finished 1000 requests

Server Software: Apache/2.2.16
Server Hostname: tech.kulish.com
Server Port: 80


Document Path: /index.php
Document Length: 0 bytes


Concurrency Level: 5
Time taken for tests: 195.169 seconds
Complete requests: 1000
Failed requests: 0
Write errors: 0
Non-2xx responses: 1000
Total transferred: 474000 bytes
HTML transferred: 0 bytes
Requests per second: 5.12 [#/sec] (mean)
Time per request: 975.847 [ms] (mean)
Time per request: 195.169 [ms] (mean, across all concurrent requests)
Transfer rate: 2.37 [Kbytes/sec] received


Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 2.8 0 90
Processing: 318 973 2219.7 595 27929
Waiting: 318 965 2209.7 591 27929
Total: 319 974 2219.9 595 27929


Percentage of the requests served within a certain time (ms)
50% 595
66% 663
75% 715
80% 761
90% 1014
95% 1855
98% 4427
99% 15662
100% 27929 (longest request)



NGINX:
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/


Benchmarking tech.kulish.com (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Completed 1000 requests
Finished 1000 requests

Server Software: nginx/1.0.10
Server Hostname: tech.kulish.com
Server Port: 80


Document Path: /index.php
Document Length: 0 bytes


Concurrency Level: 5
Time taken for tests: 109.310 seconds
Complete requests: 1000
Failed requests: 0
Write errors: 0
Non-2xx responses: 1000
Total transferred: 411000 bytes
HTML transferred: 0 bytes
Requests per second: 9.15 [#/sec] (mean)
Time per request: 546.548 [ms] (mean)
Time per request: 109.310 [ms] (mean, across all concurrent requests)
Transfer rate: 3.67 [Kbytes/sec] received


Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.6 0 10
Processing: 280 546 80.1 543 1022
Waiting: 280 546 80.1 543 1022
Total: 280 546 80.0 543 1022


Percentage of the requests served within a certain time (ms)
50% 543
66% 573
75% 592
80% 605
90% 641
95% 674
98% 735
99% 779
100% 1022 (longest request)

]]> http://tech.kulish.com/2011/11/19/apache-to-nginx-migration/feed/ 0 irc.diff.05142011.2.txt http://tech.kulish.com/2011/05/14/irc-diff-05142011-2-txt/ http://tech.kulish.com/2011/05/14/irc-diff-05142011-2-txt/#comments Sun, 15 May 2011 04:57:57 +0000 Null http://tech.kulish.com/?p=319
Index: irc.php
===================================================================
--- irc.php (revision 2317)
+++ irc.php (working copy)
@@ -1,10 +1,6 @@
#!/usr/bin/env php

-# status
-# reboot
-# log
-# help
-# down
+# port_info is broken. always reports same values no matter host selected

@@ -23,14 +19,33 @@
# Redirect to /dev/null if you aren't using screen to keep tabs
echo "Observer Bot Starting ...\n";
echo "\n";
-echo "COMMAND\t\tHOST\t\t\tDEVICE\n";
-echo "-------\t\t----\t\t\t------\n";
+echo "Timestamp Command\n";
+echo "----------------- ------- \n";

class observiumbot

{

+
###
+# Get HELP!
+###
+ function help_info(&$irc, &$data)
+ {
+
+global $config;
+
+$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Commands: !help, !log, !status, !version, !down, !port, !device, !listdevices");
+
+echo date("m-d-y H:i:s ");
+echo "HELP\n";
+
+mysql_close();
+
+ }
+
+
+###
# Get status on !version
###
function version_info(&$irc, &$data)
@@ -40,6 +55,7 @@

$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Observium Version " . $config['version']);

+echo date("m-d-y H:i:s ");
echo "VERSION\t\t". $config['version'] . "\n";

mysql_close();
@@ -47,6 +63,31 @@
}

###
+# Get last eventlog entry
+###
+ function log_info(&$irc, &$data)
+ {
+
+global $config;
+
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);
+
+ $device = dbFetchRow("SELECT `event_id`,`host`,`datetime`,`message`,`type` FROM `eventlog` ORDER BY `event_id` DESC LIMIT 1");
+ $host=$device['host'];
+ $hostid = dbFetchRow("SELECT `hostname` FROM `devices` WHERE `device_id` = $host");
+
+$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $device['event_id'] ." ". $hostid['hostname'] ." ". $device['datetime'] ." ". $device['message'] ." ". $device['type']);
+
+echo date("m-d-y H:i:s ");
+echo "LOG\n";
+
+mysql_close();
+
+ }
+
+
+###
# Get status on !down devices
###
function down_info(&$irc, &$data)
@@ -56,18 +97,16 @@
mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
mysql_select_db($config['db_name']);

- $query = mysql_query("SELECT * FROM `devices` where status=0");
- unset($message);
- while($device = mysql_fetch_assoc($query))
+ foreach (dbFetchRows("SELECT * FROM `devices` where status=0") as $device)
{
$message .= $sep . $device['hostname'];
$sep = ", ";
}
$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $message);
- unset($sep);

mysql_close();

+echo date("m-d-y H:i:s ");
echo "DOWN\n";

}
@@ -92,9 +131,10 @@
if ($device['ignore']) { $status = "*Ignored*"; }
if ($device['disabled']) { $status = "*Disabled*"; }

- $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, '#'.$device['device_id'] . " " . $device['os'] . " " . $device['version'] . " " .
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $device['os'] . " " . $device['version'] . " " .
$device['features'] . " " . $status);

+echo date("m-d-y H:i:s ");
echo "DEVICE\t\t". $device['hostname']."\n";

}
@@ -122,10 +162,11 @@
$pps_in = format_bi($port['ifInUcastPkts_rate']);
$pps_out = format_bi($port['ifOutUcastPkts_rate']);

- $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, '#' . $port['interface_id'] . " " . $port['ifAdminStatus'] . "/" . $port['ifOperStatus'] . " " .
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $port['ifAdminStatus'] . "/" . $port['ifOperStatus'] . " " .
$bps_in. " > bps > " . $bps_out . " | " . $pps_in. "pps > PPS > " . $pps_out ."pps");

-echo "PORT\t\t" . $hostname . "\t". $ifname . "\n";
+echo date("m-d-y H:i:s ");
+echo "PORT\t\t\t" . $hostname . "\t". $ifname . "\n";

}

@@ -152,9 +193,58 @@
$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $message);
unset($sep);

+echo date("m-d-y H:i:s ");
echo "LISTDEVICES\n";

}
+
+
+###
+# !status gives overall status
+###
+ function status_info(&$irc, &$data)
+ {
+ $statustype = $data->messageex[1];
+
+global $config;
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);
+
+ if ($statustype == "dev") {
+ $devcount = array_pop(dbFetchRow("SELECT count(*) FROM devices"));
+ $devup = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE status = '1' AND `ignore` = '0'"));
+ $devdown = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE status = '0' AND `ignore` = '0'"));
+ $devign = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE `ignore` = '1'"));
+ $devdis = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE `disabled` = '1'"));
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Devices: " .$devcount . " (" .$devup . " up, " .$devdown . " down, " .$devign . " ignored, " .$devdis . " disabled" . ")"); }
+
+ else if ($statustype == "prt") {
+ $prtcount = array_pop(dbFetchRow("SELECT count(*) FROM ports"));
+ $prtup = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE I.ifOperStatus = 'up' AND I.ignore = '0' AND I.device_id = D.device_id AND D.ignore = '0'"));
+ $prtdown = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE I.ifOperStatus = 'down' AND I.ifAdminStatus = 'up' AND I.ignore = '0' AND D.device_id = I.device_id AND D.ignore = '0'"));
+ $prtsht = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE I.ifAdminStatus = 'down' AND I.ignore = '0' AND D.device_id = I.device_id AND D.ignore = '0'"));
+ $prtign = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE D.device_id = I.device_id AND (I.ignore = '1' OR D.ignore = '1')"));
+ $prterr = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE D.device_id = I.device_id AND (I.ignore = '0' OR D.ignore = '0') AND (I.ifInErrors_delta > '0' OR I.ifOutErrors_delta > '0')"));
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Ports: " .$prtcount . " (" .$prtup . " up, " .$prtdown . " down, " .$prtign . " ignored, " .$prtsht . " shutdown" . ")");}
+
+ else if ($statustype == "srv") {
+ $srvcount = array_pop(dbFetchRow("SELECT count(service_id) FROM services"));
+ $srvup = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_status = '1' AND service_ignore ='0'"));
+ $srvdown = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_status = '0' AND service_ignore = '0'"));
+ $srvign = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_ignore = '1'"));
+ $srvdis = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_disabled = '1'"));
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Services: " .$srvcount . " (" .$srvup . " up, " .$srvdown . " down, " .$srvign . " ignored, " .$srvdis . " disabled" . ")"); }
+
+ else {
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Error: STATUS requires one of the following "); }
+
+mysql_close();
+
+echo date("m-d-y H:i:s ");
+echo "STATUS\t\t$statustype\n";
+
+ }
+
}

$bot = &new observiumbot();
@@ -166,6 +256,9 @@
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!port', $bot, 'port_info');
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!down', $bot, 'down_info');
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!version', $bot, 'version_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!status', $bot, 'status_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!log', $bot, 'log_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!help', $bot, 'help_info');

$irc->connect($config['irc_host'], $config['irc_port']);
$irc->login($config['irc_nick'], 'Observium Bot', 0, $config['irc_nick']);

]]> http://tech.kulish.com/2011/05/14/irc-diff-05142011-2-txt/feed/ 0 irc.diff.05142011.1.txt http://tech.kulish.com/2011/05/14/irc-diff-05142011-1-txt/ http://tech.kulish.com/2011/05/14/irc-diff-05142011-1-txt/#comments Sun, 15 May 2011 04:56:47 +0000 Null http://tech.kulish.com/?p=316
Index: irc.php
===================================================================
--- irc.php (revision 2317)
+++ irc.php (working copy)
@@ -1,11 +1,5 @@
#!/usr/bin/env php

-# status
-# reboot
-# log
-# help
-# down
-

# Disable annoying messages... well... all messages actually :)
@@ -23,14 +17,33 @@
# Redirect to /dev/null if you aren't using screen to keep tabs
echo "Observer Bot Starting ...\n";
echo "\n";
-echo "COMMAND\t\tHOST\t\t\tDEVICE\n";
-echo "-------\t\t----\t\t\t------\n";
+echo "Timestamp Command\n";
+echo "----------------- ------- \n";

class observiumbot

{

+
###
+# Get HELP!
+###
+ function help_info(&$irc, &$data)
+ {
+
+global $config;
+
+$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Commands: !help, !log, !status, !version, !down, !port, !device, !listdevices");
+
+echo date("m-d-y H:i:s ");
+echo "HELP\n";
+
+mysql_close();
+
+ }
+
+
+###
# Get status on !version
###
function version_info(&$irc, &$data)
@@ -40,6 +53,7 @@

$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Observium Version " . $config['version']);

+echo date("m-d-y H:i:s ");
echo "VERSION\t\t". $config['version'] . "\n";

mysql_close();
@@ -47,6 +61,31 @@
}

###
+# Get last eventlog entry
+###
+ function log_info(&$irc, &$data)
+ {
+
+global $config;
+
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);
+
+ $device = dbFetchRow("SELECT `event_id`,`host`,`datetime`,`message`,`type` FROM `eventlog` ORDER BY `event_id` DESC LIMIT 1");
+ $host=$device['host'];
+ $hostid = dbFetchRow("SELECT `hostname` FROM `devices` WHERE `device_id` = $host");
+
+$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $device['event_id'] ." ". $hostid['hostname'] ." ". $device['datetime'] ." ". $device['message'] ." ". $device['type']);
+
+echo date("m-d-y H:i:s ");
+echo "LOG\n";
+
+mysql_close();
+
+ }
+
+
+###
# Get status on !down devices
###
function down_info(&$irc, &$data)
@@ -56,18 +95,16 @@
mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
mysql_select_db($config['db_name']);

- $query = mysql_query("SELECT * FROM `devices` where status=0");
- unset($message);
- while($device = mysql_fetch_assoc($query))
+ foreach (dbFetchRows("SELECT * FROM `devices` where status=0") as $device)
{
$message .= $sep . $device['hostname'];
$sep = ", ";
}
$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $message);
- unset($sep);

mysql_close();

+echo date("m-d-y H:i:s ");
echo "DOWN\n";

}
@@ -92,9 +129,10 @@
if ($device['ignore']) { $status = "*Ignored*"; }
if ($device['disabled']) { $status = "*Disabled*"; }

- $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, '#'.$device['device_id'] . " " . $device['os'] . " " . $device['version'] . " " .
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $device['os'] . " " . $device['version'] . " " .
$device['features'] . " " . $status);

+echo date("m-d-y H:i:s ");
echo "DEVICE\t\t". $device['hostname']."\n";

}
@@ -122,10 +160,11 @@
$pps_in = format_bi($port['ifInUcastPkts_rate']);
$pps_out = format_bi($port['ifOutUcastPkts_rate']);

- $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, '#' . $port['interface_id'] . " " . $port['ifAdminStatus'] . "/" . $port['ifOperStatus'] . " " .
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $port['ifAdminStatus'] . "/" . $port['ifOperStatus'] . " " .
$bps_in. " > bps > " . $bps_out . " | " . $pps_in. "pps > PPS > " . $pps_out ."pps");

-echo "PORT\t\t" . $hostname . "\t". $ifname . "\n";
+echo date("m-d-y H:i:s ");
+echo "PORT\t\t\t" . $hostname . "\t". $ifname . "\n";

}

@@ -152,9 +191,58 @@
$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $message);
unset($sep);

+echo date("m-d-y H:i:s ");
echo "LISTDEVICES\n";

}
+
+
+###
+# !status gives overall status
+###
+ function status_info(&$irc, &$data)
+ {
+ $statustype = $data->messageex[1];
+
+global $config;
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);
+
+ if ($statustype == "dev") {
+ $devcount = array_pop(dbFetchRow("SELECT count(*) FROM devices"));
+ $devup = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE status = '1' AND `ignore` = '0'"));
+ $devdown = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE status = '0' AND `ignore` = '0'"));
+ $devign = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE `ignore` = '1'"));
+ $devdis = array_pop(dbFetchRow("SELECT count(*) FROM devices WHERE `disabled` = '1'"));
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Devices: " .$devcount . " (" .$devup . " up, " .$devdown . " down, " .$devign . " ignored, " .$devdis . " disabled" . ")"); }
+
+ else if ($statustype == "prt") {
+ $prtcount = array_pop(dbFetchRow("SELECT count(*) FROM ports"));
+ $prtup = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE I.ifOperStatus = 'up' AND I.ignore = '0' AND I.device_id = D.device_id AND D.ignore = '0'"));
+ $prtdown = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE I.ifOperStatus = 'down' AND I.ifAdminStatus = 'up' AND I.ignore = '0' AND D.device_id = I.device_id AND D.ignore = '0'"));
+ $prtsht = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE I.ifAdminStatus = 'down' AND I.ignore = '0' AND D.device_id = I.device_id AND D.ignore = '0'"));
+ $prtign = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE D.device_id = I.device_id AND (I.ignore = '1' OR D.ignore = '1')"));
+ $prterr = array_pop(dbFetchRow("SELECT count(*) FROM ports AS I, devices AS D WHERE D.device_id = I.device_id AND (I.ignore = '0' OR D.ignore = '0') AND (I.ifInErrors_delta > '0' OR I.ifOutErrors_delta > '0')"));
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Ports: " .$prtcount . " (" .$prtup . " up, " .$prtdown . " down, " .$prtign . " ignored, " .$prtsht . " shutdown" . ")");}
+
+ else if ($statustype == "srv") {
+ $srvcount = array_pop(dbFetchRow("SELECT count(service_id) FROM services"));
+ $srvup = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_status = '1' AND service_ignore ='0'"));
+ $srvdown = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_status = '0' AND service_ignore = '0'"));
+ $srvign = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_ignore = '1'"));
+ $srvdis = array_pop(dbFetchRow("SELECT count(service_id) FROM services WHERE service_disabled = '1'"));
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Services: " .$srvcount . " (" .$srvup . " up, " .$srvdown . " down, " .$srvign . " ignored, " .$srvdis . " disabled" . ")"); }
+
+ else {
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Error: STATUS requires one of the following "); }
+
+mysql_close();
+
+echo date("m-d-y H:i:s ");
+echo "STATUS\t\t$statustype\n";
+
+ }
+
}

$bot = &new observiumbot();
@@ -166,6 +254,9 @@
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!port', $bot, 'port_info');
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!down', $bot, 'down_info');
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!version', $bot, 'version_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!status', $bot, 'status_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!log', $bot, 'log_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!help', $bot, 'help_info');

$irc->connect($config['irc_host'], $config['irc_port']);
$irc->login($config['irc_nick'], 'Observium Bot', 0, $config['irc_nick']);

]]> http://tech.kulish.com/2011/05/14/irc-diff-05142011-1-txt/feed/ 0 irc.diff.05142011.txt http://tech.kulish.com/2011/05/14/irc-diff-05142011-txt/ http://tech.kulish.com/2011/05/14/irc-diff-05142011-txt/#comments Sun, 15 May 2011 04:55:49 +0000 Null http://tech.kulish.com/?p=312
Index: irc.php
===================================================================
--- irc.php (revision 2284)
+++ irc.php (working copy)
@@ -1,37 +1,122 @@
#!/usr/bin/env php
+
+# status
+# reboot
+# log
+# help
+# down
+

-include("includes/defaults.inc.php");
-include("config.php");
-include("includes/functions.php");
-include("includes/discovery/functions.inc.php");
+# Disable annoying messages... well... all messages actually :)
+error_reporting(0);

+include_once("includes/defaults.inc.php");
+include_once("config.php");
+include_once("includes/functions.php");
+include_once("includes/discovery/functions.inc.php");
+
include_once('Net/SmartIRC.php');

+mysql_close();
+
+# Redirect to /dev/null if you aren't using screen to keep tabs
+echo "Observer Bot Starting ...\n";
+echo "\n";
+echo "COMMAND\t\tHOST\t\t\tDEVICE\n";
+echo "-------\t\t----\t\t\t------\n";
+
class observiumbot
+
{
+
+###
+# Get status on !version
+###
+ function version_info(&$irc, &$data)
+ {
+
+global $config;
+
+$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, "Observium Version " . $config['version']);
+
+echo "VERSION\t\t". $config['version'] . "\n";
+
+mysql_close();
+
+ }
+
+###
+# Get status on !down devices
+###
+ function down_info(&$irc, &$data)
+ {
+
+global $config;
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);
+
+ $query = mysql_query("SELECT * FROM `devices` where status=0");
+ unset($message);
+ while($device = mysql_fetch_assoc($query))
+ {
+ $message .= $sep . $device['hostname'];
+ $sep = ", ";
+ }
+ $irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $message);
+ unset($sep);
+
+mysql_close();
+
+echo "DOWN\n";
+
+ }
+
+###
+# Get status on !device
+###
function device_info(&$irc, &$data)
{
+
$hostname = $data->messageex[1];

- $device = mysql_fetch_assoc(mysql_query("SELECT * FROM `devices` WHERE `hostname` = '".mres($hostname)."'"));
+global $config;
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);

+ $device = dbFetchRow("SELECT * FROM `devices` WHERE `hostname` = ?",array($hostname));
+
+mysql_close();
+
if ($device['status'] == 1) { $status = "Up " . formatUptime($device['uptime'] . " "); } else { $status = "Down "; }
if ($device['ignore']) { $status = "*Ignored*"; }
if ($device['disabled']) { $status = "*Disabled*"; }

$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, '#'.$device['device_id'] . " " . $device['os'] . " " . $device['version'] . " " .
$device['features'] . " " . $status);
+
+echo "DEVICE\t\t". $device['hostname']."\n";
+
}

+
+###
+# Get status on !port
+###
function port_info(&$irc, &$data)
{
$hostname = $data->messageex[1];
$ifname = $data->messageex[2];

- $device = mysql_fetch_assoc(mysql_query("SELECT * FROM `devices` WHERE `hostname` = '".mres($hostname)."'"));
- $port = mysql_fetch_assoc(mysql_query("SELECT * FROM `ports` WHERE `ifName` = '".mres($ifname)."' OR `ifDescr` = '".mres($ifname)."' AND device_id = '".$device['device_id']."'"));
+global $config;
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);

+ $device = dbFetchRow("SELECT * FROM `devices` WHERE `hostname` = ?",array($device));
+ $port = dbFetchRow("SELECT * FROM `ports` WHERE `ifName` = ? OR `ifDescr` = ? AND device_id = ?", array($ifname, $ifname, $device['device_id']));
+
+mysql_close();
+
$bps_in = formatRates($port['ifInOctets_rate']);
$bps_out = formatRates($port['ifOutOctets_rate']);
$pps_in = format_bi($port['ifInUcastPkts_rate']);
@@ -39,19 +124,36 @@

$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, '#' . $port['interface_id'] . " " . $port['ifAdminStatus'] . "/" . $port['ifOperStatus'] . " " .
$bps_in. " > bps > " . $bps_out . " | " . $pps_in. "pps > PPS > " . $pps_out ."pps");
+
+echo "PORT\t\t" . $hostname . "\t". $ifname . "\n";
+
}

+
+###
+# !listdevices lists all devices
+###
function list_devices(&$irc, &$data)
{
- $query = mysql_query("SELECT * FROM `devices`");
- unset($message);
- while($device = mysql_fetch_assoc($query))
+ unset ($message);
+
+global $config;
+mysql_connect($config['db_host'],$config['db_user'],$config['db_pass']);
+mysql_select_db($config['db_name']);
+
+ foreach (dbFetchRows("SELECT `hostname` FROM `devices`") as $device)
{
$message .= $sep . $device['hostname'];
$sep = ", ";
}
+
+mysql_close();
+
$irc->message(SMARTIRC_TYPE_CHANNEL, $data->channel, $message);
unset($sep);
+
+echo "LISTDEVICES\n";
+
}
}

@@ -62,6 +164,8 @@
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!listdevices', $bot, 'list_devices');
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!device', $bot, 'device_info');
$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!port', $bot, 'port_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!down', $bot, 'down_info');
+$irc->registerActionhandler(SMARTIRC_TYPE_CHANNEL, '!version', $bot, 'version_info');

$irc->connect($config['irc_host'], $config['irc_port']);
$irc->login($config['irc_nick'], 'Observium Bot', 0, $config['irc_nick']);

]]> http://tech.kulish.com/2011/05/14/irc-diff-05142011-txt/feed/ 0 Seagate ST32000542AS 2TB Setup http://tech.kulish.com/2011/03/05/seagate-st32000542as-2tb-setup/ http://tech.kulish.com/2011/03/05/seagate-st32000542as-2tb-setup/#comments Sat, 05 Mar 2011 20:55:09 +0000 Null http://tech.kulish.com/?p=266 A lot of ST32000542AS drives come with the CC34 firmware. Apparently it has various known problems, one of which is an annoying click (click of death). The first thing you’ll want to do is upgrade the firmware to CC35. A Link to the instructions is in the references section below.

Once that is done, the next step, if it exists, is removing HPA from the drive.
You’ll know it has HPA enabled by running hparm. HPA results in less capacity and so it’s not a good thing in an array.

We’ll be using Debian 6.0 (squeeze).

hparm -N /dev/sdb

You should see a difference in the numbers here. I chose to take the highest number. This completely disables HPA.

hdparm -N p3907029168 /dev/sdb

Finally, we should end up with full usability of the drive.

fdisk -l /dev/sdb

Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0×00000000

Disk /dev/sdb doesn’t contain a valid partition table

Power cycle (not reboot) to confirm settings survive.

References:
Updating the firmware on the drives:
Seagate 2TB ST32000542AS CC35 Firmware upgrade

Disabling HPA using hdparm:
unRAID Server Community parity

]]> http://tech.kulish.com/2011/03/05/seagate-st32000542as-2tb-setup/feed/ 0 Debian Squeeze iscsitarget http://tech.kulish.com/2011/03/04/debian-squeeze-iscsitarget/ http://tech.kulish.com/2011/03/04/debian-squeeze-iscsitarget/#comments Sat, 05 Mar 2011 01:25:20 +0000 Null http://tech.kulish.com/?p=262 Since Debian squeeze doesn’t appear to include pre-built iscsitarget kernel modules, the iscsitartget-dkms must be installed. This is a source package and will install gcc etc to compile. It should compile automatically.

apt-get install iscsitarget-dkms

Here is a list of iscsi related packages I installed on my secondary NAS:
iscsitarget 1.4.20.2-1 iSCSI Enterprise Target userland tools
iscsitarget-dkms 1.4.20.2-1 iSCSI Enterprise Target kernel module source – dkms version
open-iscsi 2.0.871.3-2squeeze1 High performance, transport independent iSCSI implementation

I found this info in a bug report through google after I received a module not found error when issuing a /etc/init.d/iscsitarget restart

]]> http://tech.kulish.com/2011/03/04/debian-squeeze-iscsitarget/feed/ 3 Email Cleanup http://tech.kulish.com/2011/02/19/email-cleanup/ http://tech.kulish.com/2011/02/19/email-cleanup/#comments Sat, 19 Feb 2011 14:08:17 +0000 Null http://tech.kulish.com/?p=259 Our email server directories will be cleaned out February 28th.

What this means…

All ham and spam folders will be completely wiped cleaned.
If you have email in either folder on your account, move it to your inbox or create a new folder to store it.

Thanks.
The Administration

]]> http://tech.kulish.com/2011/02/19/email-cleanup/feed/ 0 HTTPS Redirects http://tech.kulish.com/2011/02/18/https-redirects/ http://tech.kulish.com/2011/02/18/https-redirects/#comments Fri, 18 Feb 2011 17:17:44 +0000 Null http://tech.kulish.com/?p=248 Redirecting HTTP to HTTPS for a whole site using virtual hosts:





#Basics snipped for brevity....


   RewriteEngine on
   #RewriteBase /
   RewriteCond %{REQUEST_FILENAME} !-f
   RewriteCond %{REQUEST_FILENAME} !-d
   RewriteRule ^(.*)$ index.php?q=$1 [L,QSA]


RedirectPermanent / https://www.foo.com/
]]> http://tech.kulish.com/2011/02/18/https-redirects/feed/ 0 CTRL-ALT-DEL: Debian on Desktop http://tech.kulish.com/2011/01/25/ctrl-alt-del-debian-on-desktop/ http://tech.kulish.com/2011/01/25/ctrl-alt-del-debian-on-desktop/#comments Tue, 25 Jan 2011 19:17:49 +0000 Null http://tech.kulish.com/?p=237 I run debian+gnome on a VMware desktop. One of the annoying things is when I press CTRL-ALT-DEL to lock Windows (the hosting OS), the guest OS picks it up and I come back to a powered down VM.

Google results will tell you that disabling it in /etc/inittab or gconf-edit will do the trick. That’s just not the case.

You need to go to system > preferences > keyboard shortcuts and disable it there.

This completely disables it.

]]> http://tech.kulish.com/2011/01/25/ctrl-alt-del-debian-on-desktop/feed/ 0