Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Linear and Logistic Regression Parameters & Improve Documentation #8982

Merged

Conversation

rithin-pullela-aws
Copy link
Contributor

@rithin-pullela-aws rithin-pullela-aws commented Dec 23, 2024

  • Add comprehensive documentation for supported:
    • Optimizers (SIMPLE_SGD, LINEAR_DECAY_SGD, etc.)
    • Objective types (ABSOLUTE_LOSS, HUBER, SQUARED_LOSS)
    • Momentum types (STANDARD, NESTEROV)
  • Fix parameter name typos

Description

Describe what this change achieves.

Issues Resolved

Closes #8981

Version

List the OpenSearch version to which this PR applies, e.g. 2.14, 2.12--2.14, or all.

Frontend features

If you're submitting documentation for an OpenSearch Dashboards feature, add a video that shows how a user will interact with the UI step by step. A voiceover is optional.

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

- Add comprehensive documentation for supported:
  - Optimizers (SIMPLE_SGD, LINEAR_DECAY_SGD, etc.)
  - Objective types (ABSOLUTE_LOSS, HUBER, SQUARED_LOSS)
  - Momentum types (STANDARD, NESTEROV)
- Fix parameter name typos

Signed-off-by: rithin-pullela-aws <[email protected]>
Copy link

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review.

@rithin-pullela-aws
Copy link
Contributor Author

Copy link
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @rithin-pullela-aws! Could we add some more information for the user about these options?

_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Show resolved Hide resolved
rithin-pullela-aws and others added 2 commits January 2, 2025 15:52
Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>
Copy link
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks so much, @rithin-pullela-aws! LGTM

@kolchfa-aws kolchfa-aws added the backport 2.18 PR: Backport label for 2.18 label Jan 8, 2025
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kolchfa-aws Please see my comments and changes and tag me for approval when complete. Thanks!

_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
`optimiser` | String | The optimizer used in the model. | `SIMPLE_SGD`
`objective` | String | The Objective function used. | `SQUARED_LOSS`
`epochs` | Integer | The number of iterations. | `5`|
`batch_size` | Integer | The size of min batches. | `1`
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"The minimum batch size"?

_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
_ml-commons-plugin/algorithms.md Outdated Show resolved Hide resolved
| `momentumType` | String | The Stochastic Gradient Descent (SGD) momentum that helps accelerate gradient vectors in the right direction, leading to faster convergence between vectors. | `STANDARD` |
| `optimizerType` | String | The optimizer used in the model. | `AdaGrad` |
| `decay_rate` | Double | The Root Mean Squared Propagation (RMSProp). | `0.9` |
| `momentum_type` | String | The Stochastic Gradient Descent (SGD) momentum that helps accelerate gradient vectors in the correct direction, leading to faster convergence between vectors. | `STANDARD` |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On line 79, "correct direction, leading to faster convergence between vectors" is "right directions, leading to a fast convergence". Please make consistent.

| `epochs` | Integer | The number of iterations. | `5` |
| `batchSize` | Integer | The size of min batches. | `1` |
| `loggingInterval` | Integer | The interval of logs lost after many iterations. The interval is `1` if the algorithm contains no logs. | `1000` |
| `batch_size` | Integer | The size of min batches. | `1` |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"The minimum batch size"?

@kolchfa-aws
Copy link
Collaborator

@natebower Comments addressed, thanks!

Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@kolchfa-aws kolchfa-aws merged commit ff2f71b into opensearch-project:main Jan 9, 2025
6 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Jan 9, 2025
…ion (#8982)

* Update Linear and Logistic Regression Parameters & Improve Documentation

- Add comprehensive documentation for supported:
  - Optimizers (SIMPLE_SGD, LINEAR_DECAY_SGD, etc.)
  - Objective types (ABSOLUTE_LOSS, HUBER, SQUARED_LOSS)
  - Momentum types (STANDARD, NESTEROV)
- Fix parameter name typos

Signed-off-by: rithin-pullela-aws <[email protected]>

* Update _ml-commons-plugin/algorithms.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>

* Added Tribuo documentation links to optimizers, Objective types, and momentum type.

Signed-off-by: rithin-pullela-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: rithin-pullela-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
(cherry picked from commit ff2f71b)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
russcam pushed a commit to russcam/documentation-website that referenced this pull request Jan 10, 2025
…ion (opensearch-project#8982)

* Update Linear and Logistic Regression Parameters & Improve Documentation

- Add comprehensive documentation for supported:
  - Optimizers (SIMPLE_SGD, LINEAR_DECAY_SGD, etc.)
  - Objective types (ABSOLUTE_LOSS, HUBER, SQUARED_LOSS)
  - Momentum types (STANDARD, NESTEROV)
- Fix parameter name typos

Signed-off-by: rithin-pullela-aws <[email protected]>

* Update _ml-commons-plugin/algorithms.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>

* Added Tribuo documentation links to optimizers, Objective types, and momentum type.

Signed-off-by: rithin-pullela-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: rithin-pullela-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
russcam pushed a commit to russcam/documentation-website that referenced this pull request Jan 12, 2025
…ion (opensearch-project#8982)

* Update Linear and Logistic Regression Parameters & Improve Documentation

- Add comprehensive documentation for supported:
  - Optimizers (SIMPLE_SGD, LINEAR_DECAY_SGD, etc.)
  - Objective types (ABSOLUTE_LOSS, HUBER, SQUARED_LOSS)
  - Momentum types (STANDARD, NESTEROV)
- Fix parameter name typos

Signed-off-by: rithin-pullela-aws <[email protected]>

* Update _ml-commons-plugin/algorithms.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>

* Added Tribuo documentation links to optimizers, Objective types, and momentum type.

Signed-off-by: rithin-pullela-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: rithin-pullela-aws <[email protected]>
Signed-off-by: Rithin Pullela <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Russ Cam <[email protected]>
@rithin-pullela-aws rithin-pullela-aws deleted the linear-regression branch January 14, 2025 00:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.18 PR: Backport label for 2.18
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[DOC] Update Linear and Logistic Regression Parameters & Improve Documentation
3 participants