Gaurav Mantri05/15/12
150 views
0 replies
Here's an informative table detailing various characteristics and services offered by both WATS and ADDB, including consumption based pricing, indexing support, and consistency model types.
Gaurav Mantri05/15/12
1250 views
0 replies
This is a continuation of a previous post that Guarav Mantri wrote concerning two popular cloud storage services offered by Microsoft and Amazon. Get to know the differences here.
Eric Genesky05/11/12
1118 views
0 replies
The cloud herd grew by one this week with the announcement of HP's Public Cloud, which brings some new competition to AWS, Azure, Cloud Foundry, and other cloud services. Read on for a few more updates.
Wely Lau05/11/12
3759 views
0 replies
A look at the likes of AWS and Windows Azure reveals some of the pros and cons that come with various levels of self- and service- managed features for IaaSes and PaaSes.
Gaurav Mantri05/10/12
2333 views
0 replies
In this blog post, we’re going to compare Windows Azure Blob Storage Service and Amazon Simple Storage Service (S3)
from core functionality point of view. In this blog post we’re going to
focus on core concepts, pricing and feature comparison between...
Brian Gracely05/10/12
1977 views
0 replies
Aaron and Brian talk with Randy Bias (@randybias), CTO/Founder of Cloudscaling about open cloud architectures, deploying new and web-scale applications, and the evolutions of OpenStack.
Sean Hull05/08/12
2062 views
0 replies
Funky performance, uncertain reliability, and iffy support are three risky factors to consider before migrating to the cloud.
John Whish05/07/12
1465 views
0 replies
Usin cfexecute, this makes it possible to back up each database into a separate file and then upload to Amazon S3
Muhammad Khojaye05/05/12
1266 views
0 replies
Amazon EMR is a web service using which developers can easily and efficiently process enormous amounts of data. It uses an hosted Hadoop framework running on the web-scale infrastructure of Amazon EC2 and Amazon S3.
Jon Archer05/01/12
860 views
0 replies
Jon Archer's team deals with medical video/images - ultrasounds, xrays and the like. The size of these tend to be too big for easy access, so his team turned to Amazon's SimpleDB to help capture performance information.
Jason Whaley04/27/12
1343 views
0 replies
This new AWS feature was easy to incorporate for this user - he provides a code snippet for getting started with the S3 multi-object delete functionality.
Eric Genesky04/27/12
599 views
0 replies
This week saw an update to Google App Engine, as well as the release of a few free Jenkins plugins. Here are some announcements from the big PAASes that I didn't cover this week.
Muhammad Khojaye04/23/12
1926 views
0 replies
Learn how to develop a simple WordCount application in Java on Hadoop's MapReduce framework. Then, you'll upload it to Amazon S3 and create a MapReduce job flow via Amazon EMR.
// AWS inventory to relational database
#!/bin/sh
db_name="aws_inventory"
mysql -e"drop database $db_name"
mysql -e"create database $db_name"
grep -w ^INSTANCE /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/instance_list.txt
grep -w ^TAG /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/instance_tag.txt
grep -w ^VOLUME /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/volume_list.txt
grep -w ^ATTACHMENT /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/volume_attachment.txt
grep -w ^IMAGE /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/image_list.txt
grep -w ^BLOCKDEVICE /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/blockdevice.txt
grep -w ^SNAPSHOT /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/snapshot_list.txt
grep -w ^AVAILABILITYZONE /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/zone_list.txt
grep -w ^ADDRESS /home/vserv/ec2_audit.txt > /var/lib/mysql/$db_name/address_list.txt
mysql $db_name << "my_heredoc"
set foreign_key_checks=0;
create table volume_attachment (
volume_name varchar(100),
volume_id varchar(100),
volume_instance varchar(100),
volume_mount varchar(100),
volume_status varchar(100),
volume_date varchar(100),
primary key (volume_id, volume_instance),
key (volume_instance),
constraint volume_attach_id foreign key (volume_id) references volume_list(volume_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
CREATE TABLE instance_list (
instance_name varchar(100) DEFAULT NULL,
instance_id varchar(100) DEFAULT NULL,
image_id varchar(100) DEFAULT NULL,
instance_ip varchar(100) DEFAULT NULL,
instance_private_zone varchar(100) DEFAULT NULL,
instance_status varchar(100) DEFAULT NULL,
instance_keypair varchar(100) DEFAULT NULL,
filler1 varchar(100) DEFAULT NULL,
filler2 varchar(100) DEFAULT NULL,
instance_type varchar(100) DEFAULT NULL,
instance_date varchar(100) DEFAULT NULL,
instance_zone varchar(100) DEFAULT NULL,
instance_kernel varchar(100) DEFAULT NULL,
instance_r varchar(100) DEFAULT NULL,
filler3 varchar(100) DEFAULT NULL,
instance_monitoring varchar(100) DEFAULT NULL,
instance_ip_public varchar(100) DEFAULT NULL,
instance_private varchar(100) DEFAULT NULL,
filler4 varchar(100) DEFAULT NULL,
filler5 varchar(100) DEFAULT NULL,
instance_ebs varchar(100) DEFAULT NULL,
instance_spot varchar(100) DEFAULT NULL,
instance_code varchar(100) DEFAULT NULL,
filer6 varchar(100) DEFAULT NULL,
filler7 varchar(100) DEFAULT NULL,
filler8 varchar(100) DEFAULT NULL,
instance_details varchar(100) DEFAULT NULL,
primary key (instance_id),
key (instance_zone),
key(image_id),
constraint volume_attachment_instance foreign key (instance_id) references volume_attachment (volume_instance),
constraint image_list_id foreign key (image_id) references image_list(image_id),
constraint zone_list foreign key (instance_zone) references zone_list(zone_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
CREATE TABLE instance_tag (
tag_name varchar(100) DEFAULT NULL,
tag_type varchar(100) DEFAULT NULL,
tag_instance varchar(100) DEFAULT NULL,
tag_status varchar(100) DEFAULT NULL,
tag_details varchar(100) DEFAULT NULL,
key (tag_instance),
constraint instance_tag_name foreign key (tag_instance) references instance_list(instance_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
create table snapshot_list (
snap_name varchar(100),
snap_id varchar(100),
snap_vol varchar(100),
snap_status varchar(100),
snap_date varchar(100),
snap_percent varchar(100),
snap_owner varchar(100),
snap_filler varchar(100),
snap_created varchar(100),
primary key (snap_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
create table volume_list (
volume_name varchar(100),
volume_id varchar(100),
volume_filler varchar(100),
volume_snap varchar(100),
volume_zone varchar(100),
volume_status varchar(100),
volume_date varchar(100),
primary key (volume_id),
key (volume_zone),
key (volume_snap),
constraint volume_list_id foreign key (volume_zone) references instance_list(instance_zone),
constraint volume_list_snap foreign key (volume_snap) references snapshot_list(snap_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
create table image_list (
image_name varchar(100),
image_id varchar(100),
image_details varchar(100),
image_owner varchar(100),
image_status varchar(100),
image_private varchar(100),
image_filler varchar(100),
image_bit varchar(100),
image_machine varchar(100),
image_kernel varchar(100),
image_filler1 varchar(100),
image_filler2 varchar(100),
image_ebs varchar(100),
image_paravirtual varchar(100) ,
primary key(image_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
create table blockdevice (
block_name varchar(100),
block_mount varchar(100),
block_id varchar(100),
block_filler varchar(100) ,
primary key(block_id),
constraint blockdevice_id foreign key (block_id) references volume_attachment(volume_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
CREATE TABLE zone_list (
filler varchar(100) DEFAULT NULL,
zone_id varchar(100) DEFAULT NULL,
filler1 varchar(100) DEFAULT NULL,
region varchar(100) DEFAULT NULL,
primary key (zone_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
CREATE TABLE address_list (
filler varchar(100) DEFAULT NULL,
public_ip varchar(100) DEFAULT NULL,
instance_id varchar(100) DEFAULT NULL,
primary key (public_ip),
key (instance_id),
constraint address_list_instance_id foreign key (instance_id) references instance_list(instance_id)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
load data infile 'instance_list.txt' into table instance_list fields terminated by '\t';
load data infile 'instance_tag.txt' into table instance_tag fields terminated by '\t';
load data infile 'volume_list.txt' into table volume_list fields terminated by '\t';
load data infile 'volume_attachment.txt' into table volume_attachment fields terminated by '\t';
load data infile 'image_list.txt' into table image_list fields terminated by '\t';
load data infile 'blockdevice.txt' into table blockdevice fields terminated by '\t';
load data infile 'snapshot_list.txt' into table snapshot_list fields terminated by '\t';
load data infile 'zone_list.txt' into table zone_list fields terminated by '\t';
load data infile 'address_list.txt' into table address_list fields terminated by '\t';
my_heredoc
Eric Genesky04/20/12
1946 views
0 replies
Here are a few updates on the Cloud that I missed this last week. Azure's got a new startup-support program, Heroku's blog gives incremental updates, and AWS opens a marketplace for its multitude of products.
