Community
Questions Library
Docs
Blog
Events
Swag
Github
Slack
JupiterOne
Discussions
Release Notes
Contact Us
Databricks - AskJ1 Community
<main> <article class="userContent"> <h2 data-id="databricks-jupiterone-integration-benefits">Databricks + JupiterOne Integration Benefits</h2> <ul><li><p>Visualize Databricks workspace's groups, users, and clusters in the JupiterOne<br> graph.</p></li> <li><p>Map Databricks users to employees in your JupiterOne account.</p></li> <li>Monitor changes to ingested Databricks resources using JupiterOne alerts.</li> </ul><h2 data-id="how-it-works">How it Works</h2> <ul><li><p>JupiterOne periodically fetches groups, users, and clusters from Databricks to<br> update the graph.</p></li> <li><p>Write JupiterOne queries to review and monitor updates to the graph, or<br> leverage existing queries.</p></li> <li><p>Configure alerts to take action when JupiterOne graph changes, or leverage<br> existing alerts.</p></li> </ul><h2 data-id="requirements">Requirements</h2> <ul><li><p>JupiterOne requires a REST access token. You need permission to create a user<br> in Databricks that will be used to obtain the API key.</p></li> <li><p>You must have permission in JupiterOne to install new integrations.</p></li> </ul><h2 data-id="support">Support</h2> <p>If you need help with this integration, please contact<br><a rel="nofollow" href="https://support.jupiterone.io">JupiterOne Support</a>.</p> <h2 data-id="integration-walkthrough">Integration Walkthrough</h2> <h3 data-id="in-databricks">In Databricks</h3> <ol><li>Go to <a rel="nofollow" href="https://accounts.gcp.databricks.com/login">Databricks GCP dashboard</a><br> and log in.</li> <li>In the <a rel="nofollow" href="https://accounts.gcp.databricks.com/workspaces">Workspaces section</a>,<br> choose the workspace.</li> <li>You will be able to see the URL on the following page that has the following<br> format: <a href="https://[numbers].[number].gcp.databricks.com" rel="nofollow">https://[numbers].[number].gcp.databricks.com</a></li> <li>Take note of it and supply it to the .env file. (Example,<br> DATABRICKS_HOST=<a href="https://1122334455.6.gcp.databricks.com)" rel="nofollow">https://1122334455.6.gcp.databricks.com)</a></li> <li>Next, click on that link to go to the workspace dashboard. Once there, click<br> on the settings icon (bottom part of left side menu) and choose "User<br> settings".</li> <li>Click "Generate New Token", add comment/description, and press "Generate".<br> Make sure to copy the token and supply it as the ENV variable<br> (DATABRICKS_ACCESS_TOKEN=[token you've just generated])</li> </ol><h3 data-id="in-jupiterone">In JupiterOne</h3> <ol><li>From the top navigation of the J1 Search homepage, select <strong>Integrations</strong>.</li> <li>Scroll to the <strong>Databricks</strong> integration tile and click it.</li> <li>Click the <strong>Add Configuration</strong> button and configure the following settings:</li> </ol><ul><li><p>Enter the <strong>Account Name</strong> by which you'd like to identify this Databricks<br> account in JupiterOne. Ingested entities will have this value stored in<br><code class="code codeInline" spellcheck="false" tabindex="0">tag.AccountName</code> when <strong>Tag with Account Name</strong> is checked.</p></li> <li><p>Enter a <strong>Description</strong> that will further assist your team when identifying<br> the integration instance.</p></li> <li><p>Select a <strong>Polling Interval</strong> that you feel is sufficient for your monitoring<br> needs. You may leave this as <code class="code codeInline" spellcheck="false" tabindex="0">DISABLED</code> and manually execute the integration.</p></li> <li><p>Enter the Databricks <strong>Host</strong> and <strong>Access Token</strong> generated for use by<br> JupiterOne.</p></li> </ul><ol start="4"><li>Click <strong>Create Configuration</strong> once all values are provided.</li> </ol><h1 data-id="how-to-uninstall">How to Uninstall</h1> <ol><li>From the top navigation of the J1 Search homepage, select <strong>Integrations</strong>.</li> <li>Scroll to the <strong>Databricks</strong> integration tile and click it.</li> <li>Identify and click the <strong>integration to delete</strong>.</li> <li>Click the <strong>trash can</strong> icon.</li> <li>Click the <strong>Remove</strong> button to delete the integration.</li> </ol><p><br></p> <h2 data-id="data-model">Data Model</h2> <h3 data-id="entities">Entities</h3> <p>The following entities are created:</p> <table><thead><tr><th>Resources</th> <th>Entity <code class="code codeInline" spellcheck="false" tabindex="0">_type</code></th> <th>Entity <code class="code codeInline" spellcheck="false" tabindex="0">_class</code></th> </tr></thead><tbody><tr><td>Cluster</td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_cluster</code></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">Cluster</code></td> </tr><tr><td>Group</td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_group</code></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">UserGroup</code></td> </tr><tr><td>User</td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_user</code></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">User</code></td> </tr><tr><td>Workspace</td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_workspace</code></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">Account</code></td> </tr></tbody></table><h3 data-id="relationships">Relationships</h3> <p>The following relationships are created:</p> <table><thead><tr><th>Source Entity <code class="code codeInline" spellcheck="false" tabindex="0">_type</code></th> <th>Relationship <code class="code codeInline" spellcheck="false" tabindex="0">_class</code></th> <th>Target Entity <code class="code codeInline" spellcheck="false" tabindex="0">_type</code></th> </tr></thead><tbody><tr><td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_group</code></td> <td><strong>HAS</strong></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_user</code></td> </tr><tr><td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_user</code></td> <td><strong>CREATED</strong></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_cluster</code></td> </tr><tr><td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_workspace</code></td> <td><strong>HAS</strong></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_cluster</code></td> </tr><tr><td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_workspace</code></td> <td><strong>HAS</strong></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_group</code></td> </tr></tbody></table><h3 data-id="mapped-relationships">Mapped Relationships</h3> <p>The following mapped relationships are created:</p> <table><thead><tr><th>Source Entity <code class="code codeInline" spellcheck="false" tabindex="0">_type</code></th> <th>Relationship <code class="code codeInline" spellcheck="false" tabindex="0">_class</code></th> <th>Target Entity <code class="code codeInline" spellcheck="false" tabindex="0">_type</code></th> <th>Direction</th> </tr></thead><tbody><tr><td><code class="code codeInline" spellcheck="false" tabindex="0">databricks_cluster</code></td> <td><strong>IS</strong></td> <td><code class="code codeInline" spellcheck="false" tabindex="0">*aws_instance*</code></td> <td>FORWARD</td> </tr></tbody></table><p><br></p> </article> </main>