Install Elasticsearch, Kibana and APM Server - Development Environment

Set Up Stage

This step is required for both Environment Watch and Data Grid Audit

How to Unblock Downloaded Files

If you download a .zip or other file from the internet, Windows may block the file and prevent it from running correctly. To unblock a file:

Right-click the downloaded file and select Properties.
In the General tab, check the box for Unblock at the bottom (if present).
Click Apply and then OK.

Step 1: Download and Install Elasticsearch 8.17.3 on one server

Download Elasticsearch 8.17.3
1. Visit Elastic’s official download page.
2. Download the 8.17.3 Windows .zip version.
3. Before extracting, see How to Unblock Downloaded Files.
4. Extract the files to C:\elastic
Install and Configure Elasticsearch 8.17.3
1. Open an elevated PowerShell and run the following command to start Elasticsearch and perform the auto installation steps:
  Copy
```
 C:\elastic\elasticsearch-8.17.3\bin\elasticsearch.bat
```
  When starting Elasticsearch for the first time, security features are enabled and configured by default:
  - Authentication and authorization are enabled, and a password is generated for the elastic built-in superuser.
  - Certificates and keys for TLS are generated for the transport and HTTP layer, and TLS is enabled and configured with these keys and certificates.
  - An enrollment token is generated for Kibana, which is valid for 30 minutes.
2. Save the token for future reference. Once the enrollment token is displayed, you need to stop Elasticsearch so you can proceed with the next steps. To do this, return to the PowerShell window where Elasticsearch is running and press Ctrl+C on your keyboard. This will safely terminate the process. The enrollment token will look similar to:
  Copy
```
 Enrollment token for Kibana:
 eyJ2ZXIiOiI4LjE3LjMiLCJ...<rest_of_token>
```
  To stop Elasticsearch after you have copied the enrollment token, click inside the PowerShell window and press Ctrl and C at the same time. This will end the running process.
3. Open an elevated PowerShell and run the following command to install Elasticsearch as a Windows service:
  Copy
```
C:\elastic\elasticsearch-8.17.3\bin\elasticsearch-service.bat install
```
  The output will look similar to:
  Copy
```
 Installing service      :  "elasticsearch-service-x64"
 Using JAVA_HOME (64-bit):  C:\Program Files\Java\jdk-17
 The service 'elasticsearch-service-x64' has been installed.
```

Run Elasticsearch as a Windows Service

Open an elevated PowerShell and run the following command to start the Elasticsearch service:

Copy

C:\elastic\elasticsearch-8.17.3\bin\elasticsearch-service.bat start

The output will look similar to:

Copy

Starting service   :  "elasticsearch-service-x64"
The service 'elasticsearch-service-x64' has been started.

Enable Stack Monitoring
1. Navigate to the Elasticsearch configuration folder (e.g., C:\elastic\elasticsearch-8.17.3\config) and open the elasticsearch.yml file.
2. Add the following line to enable Stack Monitoring:
  Copy
```
xpack.monitoring.collection.enabled: true
```
3. Save the changes and restart the Elasticsearch service by opening an elevated PowerShell and running the following command:
  Copy
```
Restart-Service -Name "elasticsearch-service-x64"
```
Reset the Elastic (Admin) User Password
1. The following command resets the password for the elastic user, which is the default superuser (admin) account in Elasticsearch. This account is required for logging in to Kibana and for performing administrative tasks such as managing users, roles, and system settings.
2. Navigate to ElasticSearch's bin folder(C:\elastic\elasticsearch-8.17.3\bin)
3. Open an elevated PowerShell and run the following command:
  Copy
```
.\elasticsearch-reset-password -u elastic
```
4. When prompted, press 'Y' to confirm and reset the password
5. When you run this command, a new password will be generated and displayed in the console output.
  The password is shown only once and cannot be retrieved later. Immediately record and securely store the password according to your organization’s credential management and security policies. You will need this password for future authentication to Elasticsearch and Kibana.
Install the 'mapper-size' plugin
1. Open an elevated PowerShell and run the following command to install the 'mapper-size' plugin:
  Copy
```
C:\elastic\elasticsearch-8.17.3\bin\elasticsearch-plugin install mapper-size
```
2. To verify the 'mapper-size' plugin is installed, run:
  Copy
```
C:\elastic\elasticsearch-8.17.3\bin\elasticsearch-plugin list
```
3. Restart the Elasticsearch Service. To restart the Elasticsearch service, run the following in an elevated PowerShell session:
  Copy
```
Restart-Service -Name "elasticsearch-service-x64"
```
  The output will look similar to:
  Copy
```
WARNING: Waiting for service 'Elasticsearch 8.17.3 (elasticsearch-service-x64) (elasticsearch-service-x64)' to stop...
```

Verify Elasticsearch Server

To verify Elasticsearch is running, open an elevated Command Prompt and run the following command (replace <username>, <password>, and <hostname_or_ip> with your actual values):
Copy
```
curl -u <username>:<password> -k https://<hostname_or_ip>:9200
```

The response should show basic cluster information in JSON format if the server is running and accessible.

Sample JSON response

Copy

{
    "name" : "emttest",
    "cluster_name" : "elasticsearch",
    "cluster_uuid" : "q5VtYDCQT2iNHU9dOdqomw",
    "version" : {
        "number" : "8.17.3",
        "build_flavor" : "default",
        "build_type" : "zip",
        "build_hash" : "a091390de485bd4b127884f7e565c0cad59b10d2",
        "build_date" : "2025-02-28T10:07:26.089129809Z",
        "build_snapshot" : false,
        "lucene_version" : "9.12.0",
        "minimum_wire_compatibility_version" : "7.17.0",
        "minimum_index_compatibility_version" : "7.0.0"
    },
    "tagline" : "You Know, for Search"
}

Step 2: Install and Configure Kibana

Download Kibana 8.17.3
1. Download and extract the 8.17.3 Windows .zip version of Kibana from Elastic’s official Kibana download page.
2. Before extracting, see How to Unblock Downloaded Files.
Start Kibana from the command line
1. Navigate to Kibana's bin folder (e.g., C:\elastic\kibana\bin).
2. Open an elevated PowerShell and run the following command:
  Copy
```
C:\Kibana\kibana-8.17.3\bin\kibana.bat
```
3. If successful, you should see output indicating that the Kibana server has started and is listening on port 5601. Look for lines similar to:
  Copy
```
[INFO][server][http] http server running at http://localhost:5601
...
kibana has not been configured
Go to https://localhost:5601/?code=xyz to get started
```
Enroll Kibana
1. In your terminal, click the generated link to open Kibana in your browser.
2. In your browser, paste the enrollment token that was generated in the terminal when you started Elasticsearch, then click the Configure Elastic button to connect your Kibana instance with Elasticsearch. See where the enrollment token is generated.
3. If the token has expired, generate a new one by running the following command in the Elasticsearch's bin folder (e.g., C:\elastic\elasticsearch-8.17.3\bin).
  Copy
```
C:\elastic\elasticsearch-8.17.3\bin\elasticsearch-create-enrollment-token --scope kibana
```
  Sample output
  eyJ2ZXIiOiI4LjE0LjAiLCJhZHIiOlsiMTAuMC4yLjI6OTIwMCJdLCJmZ3IiOiI4ZGE1MWZkYTExZmM1ZDAwNDBhZWZlNTJlNmRiYzQ5ZTM2NmYxYTkyOGIwY2NiMzExOGY0MWFjZTczODNkZDliIiwia2V5IjoiOGFfc1BKZ0Jra09qNlh6dngycS06bG5sWkNEMnpSbFNiZjZZclpRSHF6dyJ9
4. Log in to Kibana as the elastic user with the password that was generated when you started Elasticsearch.
5. See the screenshot below for the login screen:
Generate Kibana encryption keys
Skipping the steps below will cause the Relativity Server CLI to fail.
1. Open an elevated PowerShell and run the following command:
  Copy
```
C:\Kibana\kibana-8.17.3\bin\kibana-encryption-keys generate
```
2. If successful, you will see output showing the generated encryption keys. For example:
  Sample output
  Copy
  xpack.encryptedSavedObjects.encryptionKey: "<randomly-generated-key-1>" xpack.reporting.encryptionKey: "<randomly-generated-key-2>" xpack.security.encryptionKey: "<randomly-generated-key-3>"
3. Copy the generated encryption keys and paste them at the end of your kibana.yml file (e.g., C:\Kibana\kibana-8.17.3\config\kibana.yml). The configuration should look similar to:
  Sample kibana.yml configuration
  Copy
  xpack.encryptedSavedObjects.encryptionKey: "<randomly-generated-key-1>" xpack.reporting.encryptionKey: "<randomly-generated-key-2>" xpack.security.encryptionKey: "<randomly-generated-key-3>"
4. Restart the Kibana service, by opening an elevated PowerShell and run the following command:
  Copy
```
C:\Kibana\kibana-8.17.3\bin\kibana.bat
```
5. To verify success, check the terminal output for lines indicating that Kibana has started successfully. You can also refer to the screenshots below:
6. After Kibana has restarted, open a browser and go to http://<hostname_or_ip>:5601.
7. Log in using the elastic username and the password you generated earlier. This verifies that Kibana is running and your credentials are working.
8. For more details, refer to the official documentation: https://www.elastic.co/guide/en/kibana/current/kibana-encryption-keys.html
Create Kibana Windows Service
Running Kibana as a Windows Service is Optional Environment Watch does NOT require Kibana to run as a Windows service, nor does it require the use of NSSM. NSSM is a commonly used open-source tool to help run applications as services, but it is not mandatory. You can run Kibana manually from the command line if you prefer, and this will work perfectly for development and most production scenarios. Only use NSSM if you want Kibana to start automatically as a service on Windows. If you do not wish to use NSSM, simply run kibana.bat manually.
Copy
```
C:\Kibana\kibana-8.17.3\bin\kibana.bat
```
1. Download the latest NSSM executable from https://nssm.cc/download and place it in the C drive (e.g., C:\nssm-2.24).
  Kibana does not install as a Windows service by default. We recommend using NSSM — a commonly used open-source tool—to run Kibana as a Windows service.
2. Open an elevated PowerShell and run the following command:
  Copy
```
C:\nssm-2.24\win64\nssm.exe install kibana
```
  This will open a popup to create a Windows service for Kibana.
3. In the Application tab, enter the path to kibana.bat and its folder as shown below:
Editing Kibana Service Properties: If you accidentally install the Kibana service before completing your configuration (for example, by pressing Return too early in the NSSM dialog), you can easily edit the service properties afterward. This allows you to update the application path, log file settings, or other options without reinstalling the service. To edit the service properties, open an elevated PowerShell and run the following command: C:\nssm-2.24\win64\nssm.exe edit kibana
1. In the I/O tab, enter the full path of a log file where the service logs will be stored. For example, create a folder in the Kibana directory (e.g., C:\Kibana\kibana-8.17.3\service_logs) and a blank log file (e.g., C:\Kibana\kibana-8.17.3\service_logs\kibana_service.log).
2. Copy the full log file path into the stdout and stderr sections:
3. In the File rotation tab, check all boxes and enter 10485760 bytes so a new log file is generated for every 10 MB of logs:
4. Click the Install service button to create the Windows service for Kibana.
5. Go to the Services app in Windows, search for the kibana service, right click, and start the service.
6. Right click on the service and open Properties to change the startup type to Automatic, so Kibana runs automatically on system startup.
7. Verify that Kibana is running by opening it in your browser.
  It is normal for Kibana to take 1-5 minutes to become accessible after starting the service, depending on your system. Please be patient while it starts up.
Verify Kibana Server
1. Open a browser and go to http://<hostname_or_ip>:5601.
2. Log in using the elastic credential to verify successful access.

Step 3: Install and Configure APM Server

Prerequisites to setup APM Server
- Elastic and Kibana should be configured and services should be up and running.
Download APM Server 8.17.3
1. Visit Elastic’s APM Server page.
2. Download and extract the 8.17.3 Windows .zip file.
3. Before extracting, see How to Unblock Downloaded Files.
4. Extract the files to C:\.
Configure APM Server (C:\apm-server-8.17.3-windows-x86_64\apm-server.yml)
1. An API key is required for configuring both APM and Beats. To create an API key:
  1. Log in to Kibana (http://<hostname_or_ip>:5601) using the elastic credential.
  2. Use the global search at the top of Kibana to search for "API keys" and select it from the results.
  3. Click the Create API key button.
  4. Enter a name for your API key (for example, specify if it will be used for Beats or APM).
  5. Click the Privileges dropdown and select Beats to automatically apply the recommended permissions for Beats.
  6. Click Create API key.
  7. Copy and securely save the generated id and api_key values.
    Copy and save id and api_key values immediately and store them securely according to your organization’s credential management and security policies.
2. Navigate to the apm-server folder (e.g., C:\apm-server-8.17.3-windows-x86_64) and open the apm-server.yml file using a text editor.
3. Update the apm-server.yml file to match the following sample configuration. Replace the placeholder values (<apm-server-hostname_or_ip>, <elasticsearch-hostname_or_ip>, <id>, <api-key>) as needed for your environment. Below is a sample configuration:
  Copy
```
apm-server:
host: "<apm-server-hostname_or_ip>:8200"

output.elasticsearch:
hosts: ["<elasticsearch-hostname_or_ip>:9200"]
protocol: "https"
api_key: "<id>:<api-key>"
ssl.enabled: true
ssl.verification_mode: none

instrumentation:
enabled: true
environment: production
hosts:
- "http://<apm-server-hostname_or_ip>:8200"
```
Execute required scripts to install APM Server as a Windows service
1. Open an elevated PowerShell.
2. Run the following command to install the APM Server as a Windows service:
  Copy
```
PowerShell.exe -ExecutionPolicy UnRestricted -File C:\apm-server-8.17.3-windows-x86_64\install-service.ps1
```
  The output will look similar to:
  Copy
```
Installing service apm-server...
Service "apm-server" has been successfully installed.
```
Start the APM Server service
1. Open an elevated PowerShell and run the following command:
  Copy
```
Start-Service -Name "apm-server"
```
2. Once the instrumentation is set, you can verify it in Kibana as shown below:
Verify APM Server
1. Open an elevated Command Prompt and run the following command (replace <hostname_or_ip> with your actual value):
  Copy
```
curl -k http://<hostname_or_ip>:8200
```
  The response should indicate publish_ready is true and will look similar to:
  Copy
```
{
"build_date": "2025-02-27T18:17:35Z",
"build_sha": "f6b917b725e1a22af433e5b52c5c6f0ff9164adf",
"publish_ready": true,
"version": "8.17.3"
}
```

Step 4: Additional Setup and Verification

Add Elastic APM Integration Package
Skipping the steps below will cause the Relativity Server CLI to fail.
1. Login to Kibana and select the Elastic APM under Integration, or in the search bar type "Elastic APM" and select it under Integration.
2. In the top right, select the Add Elastic APM button.
3. Add an Integration name and for server configuration. Update apm hostname and apm url.
  Ex: Host: <hostname_or_ip>:8200
  URL: http://<hostname_or_ip>:8200
4. Click on Save and Continue.
5. Select Add Elastic Agent later button as Agent is not required for the initial setups.
Verify APM Data View
Before proceeding with EW CLI, check if the APM Data View is created in Kibana:
1. Open a browser and go to http://<hostname_or_ip>:5601
2. Log in using elastic credentials
3. Navigate to Discover, or type Discover in the search bar.
4. Confirm the APM Data View is present:
Verify Cluster Health
1. Open an elevated Command Prompt and run the following command (replace username, password, and hostname_or_ip with your actual values):
  Copy
```
curl -u <username>:<password> -k https://<hostname_or_ip>:9200/_cat/health
```
2. You should see a response similar to:
  Copy
```
1690219200 10:00:00 elasticsearch green 1 1 0 0 0 0 0 0 - 100.0%
```
3. The word green in the response means the cluster is healthy. The word yellow in the response means the cluster is partially healthy. If you see red, investigate further.

Next Step

Click here for the next step