JMeter SSH Sampler

https://github.com/linkeshkanna/Jmeter.SSH.FTP.Request

Jmeter Custom Sampler to make SFTP Request

To Create SSH FTP Requests in JMeter, we need this custom Sampler. This contains two jar files. 1. jmeter-ssh-sampler-1.0.2-SNAPSHOT.jar 2. jsch-0.1.53.jar We can generate this by downloading the source and building it using Maven.

I just built it using maven and checked in the jar files here.

To install this in Jmeter, 1. Copy the jmeter-ssh-sampler-1.0.2-SNAPSHOT.jar to the "Jmeter/Lib/ext" directory. 2. Copy the "jsch-0.1.53.jar" to the "Jmeter/Lib" directory 3. Restart Jmeter.

I have also added a sample test to list of the directory contents in a Public SFTP Server.

Install 3rdParty JAR on IBM B2B Sterling Integrator

If we want to install external JARs (3rdParty JARs) on Sterling Integrator here are the steps,

1. Stop B2BI Cluster (All Nodes) by running hardStop.sh/cmd.
2. install3rdParty.sh -j
         -j = JAR
         -l = Library File
3. Run setupfile.sh
4. Repeat Step 2 and 3 on all Nodes.
5. Restart B2BI Cluster.

Validation Procedure:

If installation was successful then you will see an entry for your new JAR file in dynamicclasspath.cfg file.  

Watch "Sterling B2B Integrator" on YouTube

Sterling B2B Integrator: http://www.youtube.com/playlist?list=PLuG9ugPnSkt5sMigpzbawknri85fFfa52

IBM Sterling B2B Integrator Map Editor Rules Hierarchy

Here is how IBM Sterling B2B Integrator map editor translator controller parse and executes the Rules.

Pre-Session (Variable Declarations & Hard Coded Values)
Root On Begin
   Root Exedend Rules
Record On Begin
Standard Rule & Exedend Rule

Record On End
Root On Begin
Post-Session (Executes before end of map)

Calling B2BI WebService from SOAP UI

soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:mesa="http://www.sterlingcommerce.com/mesa"
   soapenv:Header/
   soapenv:Body
      mesa:DEMO_WEB_SERVICE xmlns:mesa="http://www.sterlingcommerce.com/mesa"
Payload goes here....
      /mesa:DEMO_WEB_SERVICE
   /soapenv:Body

/soapenv:Envelope



Need to add namespace xmlns:mesa="http://www.sterlingcommerce.com/mesa under soapenv:Body.

Updating bashrc file in Ubuntu

Update bashrc file for to default required path variables, xclock setup etc. I find this is clean way then setting up or updating path variables under each user profile unless it is mandatory. This is clean way for sandbox setup at least not for production though.

.bashrc file location:

/etc/bash.bashrc

####Sirish Reddy: Settings ########
PATH=/u01/app/jdk1.6.0_25/bin:$PATH
export LANG=en_US
xhost local:oracle
xhost local:sirishg
xhost local:apache

"Mayor Billy Kenoi, of Hawai'i Island, at HPU's commencement" on YouTube

How To Learn Anything in 20 Hours

Here is the interesting video I came across which teach the logic on how to learn anything in 20 Hours, Interesting... 

Setting up VisualVM from Sterling Integrator

1. Download  VisualVM 

    https://java.net/projects/visualvm/downloads/download/release138/visualvm_138.zip

2. Find the value of the property called ACTIVEMQ_JMX_PORT from sandbox.cfg.

3. Add Remote Host First and under Remote Host add Add JMX Connection. 

    <SI HOST Name>:<ACTIVEMQ_JMX_PORT>

    No need of providing user credentials and Save the connection. 

Enable External Purge in Sterling Integrator

Starting an External Purge

Procedure

1. If you have a cluster installation, make sure that you are not running the external purge on another node of the cluster. If you are running the external purge on more than one node, it will cause database locks. For more information, see Monitoring an External Purge.
   Important: It is the customer's responsibility to keep exactly one of these external purge processes running in the cluster. If you need to shut down the hardware that is running the external purge, you must run the external purge on a different node.
2. Disable the default Purge service. Click Deployment > Schedules, search for PurgeService, and then clear the Enabled checkbox for PurgeService.
   Note: If you have customized the Schedule_PurgeService business process, you need to add your customized code to the new Schedule_PurgeService business process. The new Schedule_PurgeService business process includes a warning message about running the external purge while the scheduled new purge is enabled.
3. Turn off the "Important Schedules are Disabled" email notifications by adding the following line to the customer_overrides.properties file. This removes the Purge Service SQL query for the schedule.
   resourceMonitor.ScheduleMonitor.propertyValue.1=SELECT STATUS, SERVICENAME FROMSCHEDULE WHERE SERVICENAME IN ('BackupService','IndexBusinessProcessService','AssociateBPsToDocs'
   ,'BPRecovery','BPLinkagePurgeService')
4. Do the following:
   • In Windows, do one of the following:
     • Run the command startExternalPurgeWindowsService.cmd from the INSTALL_DIR\bin directory.
     • Run the Windows service. Click Control Panel > Administrative Tools > Services, right-click IBM Sterling B2B Integrator External Purge at BASE_PORT, and click Start.
   • In UNIX, run the command control_extpurge.sh start from the INSTALL_DIR/bin directory.
• In iSeries, run the command
  SBMJOB CMD (QSH CMD('cd INSTALL_DIR/bin; ./ExternalPurgeConsole.sh -clearlocks > INSTALL_DIR/logs/extpurge.log')) JOB(EXTPURGE)

http://www-01.ibm.com/support/knowledgecenter/SS3JSW_5.2.0/com.ibm.help.enhancement_external_purge_524.doc/ArchPrg_StartExtPurge.html?lang=en

Remote FTP Directory Sync using lftp

http://www.cyberciti.biz/faq/lftp-mirror-example/

$lftp user@my.ftp.com
$mirror -c source target

Reverse Sync to Server:
Change local directory to  where you saved the files /home/somedirectory
$lcd /home/somedirectory
$mirror -R

Enterprise Logging with Logstash

Basic Flow of Logstash?

LS Agent(s) (Installed on App Server(s)) --> RabbitMQ --> LS Server --> Elasticsearch Server <-- Kibana <-- end user.

So which scripting language is recommended to parse the logs or data?

There is a bunch of plugins for logstash but mostly we use the grok filter.

https://www.elastic.co/guide/en/logstash/current/plugins-filters-grok.html

It takes grok expressions which can be the special grok or even ruby regexes with named captures.

If you need help building patterns to match your logs, you will find the http://grokdebug.herokuapp.com and http://grokconstructor.appspot.com/ applications quite useful!

We need to include Puppet in setup or we can manage with out puppet?

Puppet manages LS Agents on all servers. We create filters and apply them based off the server hostgroup and also input files.

Videos on Logstash:

https://www.youtube.com/watch?v=96og3aIgyrc

https://www.youtube.com/watch?v=Kqs7UcCJquM

https://www.youtube.com/watch?v=xj3dUMI263Y

Download Logstash:

https://www.elastic.co/products/logstash

10 Management Tips