How to configure mongodb with chef

https://github.com/netinlet/chef-mongodb_replicaset.git

Note - No Brekshelf

Note EBS JSON

{
 "mongodb" : {
   "replicaset_name": "mongo-rs",
     "cluster_name": "mongo-rs",
     "auto_configure": {
       "replicaset": true
     }
 }
}

WITH EBS

{
"mongodb" : {
 "replicaset_name": "mongo-rs",
   "cluster_name": "mongo-rs",
   "auto_configure": {
     "replicaset": true
   },
 "dbpath":"/data/lib/mongodb",
 "logpath":"/data/log/mongodb"
}
}

Recipes

Setup mongodb::10gen_repo mongodb::default
auto_configure             mongodb::replicaset


Note - After you done with Installation.

Login into EC2

Master -

$ - mongo
> rs.intiate()
> rs.add("ip-10-123-25-111.ap-southeast-1.compute.internal:27017")

How to scp EC2

Machine to EC2
scp -i myAmazonKey.pem FILE ubuntu@mec2-50-17-13-12.compute-1.amazonaws.com:~/.

EC2 to local
scp -i ec2key.pem username@ec2ip:/path/to/file .

TAR File

tar cvzf nameoffiletocreate.tar.gz locationthatyouwant

example - tar cvzf harish.tar.gz /ubuntu/harish/Desktop/

Unrar TAR File

tar -xvzf harish.tar.gz

Single bucket policy

For Multiple Bucket

{
       "Version": "2012-10-17",
   "Statement": [
       {
           "Effect": "Allow",
           "Action": "s3:*",
           "Resource": [  "arn:aws:s3:::harish/*",
               "arn:aws:s3:::harish1/*"  ]
       }
                           ]
}

For Single bucket

{
"Version": "2008-10-17",
"Statement": [
{
"Sid": "AllowPublicRead",
"Effect": "Allow",
"Principal": {
"AWS": "*"
},
"Action": "s3:*",
"Resource": "arn:aws:s3:::harish/*"
}
]
}

Find server Machine IP with NGINX LUA

Step 1 install

wget http://openresty.org/download/ngx_openresty-1.7.10.2.tar.gz
tar xvzf ngx_openresty-1.7.10.2.tar.gz
cd ngx_openresty-1.7.10.2/
sudo apt-get update
sudo apt-get install libreadline-dev libncurses5-dev libpcre3-dev libssl-dev perl make build-essential
./configure --with-luajit
make
sudo make install
mkdir ~/work
cd ~/work/
mkdir conf/ logs/
vim conf/nginx.conf
PATH=/usr/local/openresty/nginx/sbin:$PATH
export PATH
nginx -p `pwd`/ -c conf/nginx.conf
curl localhost:8080

Step 2
Note - use step 2 only if you want to use content by lua and skip step 3,4
## content by lua
worker_processes  1;
error_log logs/error.log;
events {
    worker_connections 1024;
}
http {
    server {
        listen 8080;
        location / {
            default_type text/html;
            content_by_lua '
                ngx.say("<p>hello, world</p>")
            ';
        }
    }
}

Step 3
Note - use this if you want to use content by lua file in this skip step 2
## content by lua file
worker_processes  1;
error_log logs/error.log;
events {
    worker_connections 1024;
}
http {
    server {
        listen 8080;
        location / {
            default_type text/html;
            content_by_lua_file '/home/mr/cache.lua';
        }
    }
}

Step 4
Note - lua file that you want to pass from nginx
## content by lua file
vim /home/mr/cache.lua                
ngx.print(ngx.var.remote_addr)

Step 5
Note - if any isssue to start the nginx
Trobleshoot -
ps ax| grep nginx
sudo kill -9 PID

Step 6
Note - how to start nginx and open on browser IP:8080
Start ->
nginx -p `pwd`/ -c conf/nginx.conf
curl localhost:8080

How to create FTP for aws without directory Listing

Step 1

1 - apt-get install vsftpd

2 - vim /etc/vsftpd.conf

3 - changes

listen=YES

anonymous_enable=NO

local_enable=YES

write_enable=YES

dirmessage_enable=YES

use_localtime=YES

xferlog_enable=YES

connect_from_port_20=YES

chroot_local_user=YES ( First One )

secure_chroot_dir=/var/run/vsftpd/empty

pam_service_name=vsftpd

rsa_cert_file=/etc/ssl/certs/ssl-cert-snakeoil.pem

rsa_private_key_file=/etc/ssl/private/ssl-cert-snakeoil.key

pasv_enable=YES

port_enable=YES
pasv_min_port=1024
pasv_max_port=1048
pasv_address=0.0.0.0 

Note - 0.0.0.0 will be your be your public IP

Step 2

Add Port in your Security Group

tcp 20-21

tcp 1024-1048

Step 3 echo 'allow_writeable_chroot=YES' >> /etc/vsftpd.conf

Done

How to setup mongodb replSet

Master IP - 172.31.9.122
Replset IP - 172-31-17-152


Step 1 - Install mongoDB

# sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 7F0CEB10

# echo "deb http://repo.mongodb.org/apt/ubuntu "$(lsb_release -sc)"/mongodb-org/3.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-3.0.list

# sudo apt-get update

# sudo apt-get install -y mongodb-org


Step 2 - vim /etc/mongod.conf

Change
Bind Ip - 172-31-9-122 (your IP)
Replsetname - harish (Your Replset Name)


Note - Be Carefull and change according.

Step 3 - Login into mongo

mongo --host 172.31.9.122

>

rs.initiate(
{_id: "harish",
  members: [
    {
      _id: 1,
      host: "ip-172-31-9-122.ap-southeast-1.compute.internal",
      arbiterOnly: false,
      buildIndexes: true,
      priority: 1
    }
  ]
}
)

Step 4 - Install MongoDB with step 1

Step 5 -  vim /etc/mongod.conf

Change
Bind Ip - 172-31-17-152 (your IP)
Replsetname - harish (Your Replset Name)

Step 6 - Add you replset
Login to you master mongo
mongo --host 172.31.9.122
>
 rs.add('ip-172-31-17-152.ap-southeast-1.compute.internal:27017')


Note -
service mongod start
service mongod stop
service mongod status

If not running then go /var/lib/mongod/mongo.lock and delete mongo.lock file then start you mongod

How to attach EBS volume available for use on Linux

Step 1

[ec2-user ~]$ lsblk
NAME  MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
xvdf  202:80   0  100G  0 disk
xvda1 202:1    0    8G  0 disk /

Step 2

mkdir /data

Step 3

mount /dev/xvda1  /data