Fixes issue #12108: Added Ridge Regression to Machine Learning - #12246
Fixes issue #12108: Added Ridge Regression to Machine Learning#12246Harmanaya wants to merge 13 commits into
Conversation
There was a problem hiding this comment.
Click here to look at the relevant links ⬇️
🔗 Relevant Links
Repository:
Python:
Automated review generated by algorithms-keeper. If there's any problem regarding this review, please open an issue about it.
algorithms-keeper commands and options
algorithms-keeper actions can be triggered by commenting on this PR:
@algorithms-keeper reviewto trigger the checks for only added pull request files@algorithms-keeper review-allto trigger the checks for all the pull request files, including the modified files. As we cannot post review comments on lines not part of the diff, this command will post all the messages in one comment.NOTE: Commands are in beta and so this feature is restricted only to a member or owner of the organization.
|
|
||
|
|
||
| class RidgeRegression: | ||
| def __init__(self, alpha=0.001, lambda_=0.1, iterations=1000): |
There was a problem hiding this comment.
Please provide return type hint for the function: __init__. If the function does not return a value, please provide the type hint as: def function() -> None:
Please provide type hint for the parameter: alpha
Please provide type hint for the parameter: lambda_
Please provide type hint for the parameter: iterations
| self.iterations = iterations | ||
| self.theta = None | ||
|
|
||
| def feature_scaling(self, X): |
There was a problem hiding this comment.
Please provide return type hint for the function: feature_scaling. If the function does not return a value, please provide the type hint as: def function() -> None:
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function feature_scaling
Please provide type hint for the parameter: X
Please provide descriptive name for the parameter: X
| # Avoid division by zero for constant features (std = 0) | ||
| std[std == 0] = 1 # Set std=1 for constant features to avoid NaN | ||
|
|
||
| X_scaled = (X - mean) / std |
There was a problem hiding this comment.
Variable and function names should follow the snake_case naming convention. Please update the following name accordingly: X_scaled
| X_scaled = (X - mean) / std | ||
| return X_scaled, mean, std | ||
|
|
||
| def fit(self, X, y): |
There was a problem hiding this comment.
Please provide return type hint for the function: fit. If the function does not return a value, please provide the type hint as: def function() -> None:
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function fit
Please provide type hint for the parameter: X
Please provide descriptive name for the parameter: X
Please provide type hint for the parameter: y
Please provide descriptive name for the parameter: y
| :param X: Input features, shape (m, n) | ||
| :param y: Target values, shape (m,) | ||
| """ | ||
| X_scaled, mean, std = self.feature_scaling(X) # Normalize features |
There was a problem hiding this comment.
Variable and function names should follow the snake_case naming convention. Please update the following name accordingly: X_scaled
| gradient = (X_scaled.T.dot(error) + self.lambda_ * self.theta) / m | ||
| self.theta -= self.alpha * gradient # Update weights | ||
|
|
||
| def predict(self, X): |
There was a problem hiding this comment.
Please provide return type hint for the function: predict. If the function does not return a value, please provide the type hint as: def function() -> None:
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function predict
Please provide type hint for the parameter: X
Please provide descriptive name for the parameter: X
| :param X: Input features, shape (m, n) | ||
| :return: Predicted values, shape (m,) | ||
| """ | ||
| X_scaled, _, _ = self.feature_scaling(X) # Scale features using training data |
There was a problem hiding this comment.
Variable and function names should follow the snake_case naming convention. Please update the following name accordingly: X_scaled
| X_scaled, _, _ = self.feature_scaling(X) # Scale features using training data | ||
| return X_scaled.dot(self.theta) | ||
|
|
||
| def compute_cost(self, X, y): |
There was a problem hiding this comment.
Please provide return type hint for the function: compute_cost. If the function does not return a value, please provide the type hint as: def function() -> None:
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function compute_cost
Please provide type hint for the parameter: X
Please provide descriptive name for the parameter: X
Please provide type hint for the parameter: y
Please provide descriptive name for the parameter: y
| :param y: Target values, shape (m,) | ||
| :return: Computed cost | ||
| """ | ||
| X_scaled, _, _ = self.feature_scaling(X) # Scale features using training data |
There was a problem hiding this comment.
Variable and function names should follow the snake_case naming convention. Please update the following name accordingly: X_scaled
| ) * np.sum(self.theta**2) | ||
| return cost | ||
|
|
||
| def mean_absolute_error(self, y_true, y_pred): |
There was a problem hiding this comment.
Please provide return type hint for the function: mean_absolute_error. If the function does not return a value, please provide the type hint as: def function() -> None:
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function mean_absolute_error
Please provide type hint for the parameter: y_true
Please provide type hint for the parameter: y_pred
There was a problem hiding this comment.
Click here to look at the relevant links ⬇️
🔗 Relevant Links
Repository:
Python:
Automated review generated by algorithms-keeper. If there's any problem regarding this review, please open an issue about it.
algorithms-keeper commands and options
algorithms-keeper actions can be triggered by commenting on this PR:
@algorithms-keeper reviewto trigger the checks for only added pull request files@algorithms-keeper review-allto trigger the checks for all the pull request files, including the modified files. As we cannot post review comments on lines not part of the diff, this command will post all the messages in one comment.NOTE: Commands are in beta and so this feature is restricted only to a member or owner of the organization.
| scaled_features = (features - mean) / std | ||
| return scaled_features, mean, std | ||
|
|
||
| def fit(self, x: np.ndarray, y: np.ndarray) -> None: |
There was a problem hiding this comment.
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function fit
Please provide descriptive name for the parameter: x
Please provide descriptive name for the parameter: y
| gradient = (x_scaled.T.dot(error) + self.lambda_ * self.theta) / m | ||
| self.theta -= self.alpha * gradient # Update weights | ||
|
|
||
| def predict(self, x: np.ndarray) -> np.ndarray: |
There was a problem hiding this comment.
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function predict
Please provide descriptive name for the parameter: x
| x_scaled, _, _ = self.feature_scaling(x) # Scale features using training data | ||
| return x_scaled.dot(self.theta) | ||
|
|
||
| def compute_cost(self, x: np.ndarray, y: np.ndarray) -> float: |
There was a problem hiding this comment.
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function compute_cost
Please provide descriptive name for the parameter: x
Please provide descriptive name for the parameter: y
| ) * np.sum(self.theta**2) | ||
| return cost | ||
|
|
||
| def mean_absolute_error(self, y_true: np.ndarray, y_pred: np.ndarray) -> float: |
There was a problem hiding this comment.
As there is no test file in this pull request nor any test function or class in the file machine_learning/ridge_regression.py, please provide doctest for the function mean_absolute_error
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
|
@cclauss Could you please review this PR when you get a chance? |
Describe your change:
Checklist: