Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(*): Add usage metrics support for Lapi #32

Merged
merged 17 commits into from
Jan 9, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 24 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,30 @@ The [public API](https://semver.org/spec/v2.0.0.html#spec-item-1) of this libra
As far as possible, we try to adhere to [Symfony guidelines](https://symfony.com/doc/current/contributing/code/bc.html#working-on-symfony-code) when deciding whether a change is a breaking change or not.


---

## [4.0.0](https://github.com/crowdsecurity/php-remediation-engine/releases/tag/v4.0.0) - 2024-??-??
[_Compare with previous release_](https://github.com/crowdsecurity/php-remediation-engine/compare/v3.5.0...HEAD)

**This release is not published yet.**

### Added

- Add `LapiRemediation::pushUsageMetrics` method to push usage metrics to LAPI
- Add `bouncing_level` configuration to cap maximum remediation level

### Changed

- **Breaking change**: `getIpRemediation` method now returns an array with `remediation` and `origin` keys
- **Breaking change**: Change protected `AbstractRemediation::updateRemediationOriginCount` method to public
`updateMetricsOriginsCount` with new `$remediation` and `$delta` parameters.
- **Breaking change**: Do not store origins count in cache as it should be managed by the bouncer
- Update `crowdsec/lapi-client` dependency to `v3.4.0`

### Removed

- Removed deprecated methods

---

## [3.5.0](https://github.com/crowdsecurity/php-remediation-engine/releases/tag/v3.5.0) - 2024-10-18
Expand Down
2 changes: 1 addition & 1 deletion composer.json
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@
"symfony/cache": "^5.4.11|| ^6.0.11",
"crowdsec/common": "^2.3.2",
"crowdsec/capi-client": "^3.2.0",
"crowdsec/lapi-client": "^3.3.0",
"crowdsec/lapi-client": "^3.4.0",
"monolog/monolog": "^1.17 || ^2.1",
"mlocati/ip-lib": "^1.18",
"geoip2/geoip2": "^2.13.0"
Expand Down
57 changes: 48 additions & 9 deletions docs/USER_GUIDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@
- [Example scripts](#example-scripts)
- [CAPI remediation engine configurations](#capi-remediation-engine-configurations)
- [Remediation priorities](#remediation-priorities)
- [Bouncing level](#bouncing-level)
- [Remediation fallback](#remediation-fallback)
- [Geolocation](#geolocation)
- [Refresh frequency indicator](#refresh-frequency-indicator)
Expand Down Expand Up @@ -67,11 +68,13 @@ This kind of action is called a remediation and can be:
- Use the cached decisions for CAPI and for LAPI in stream mode
- For LAPI in live mode, call LAPI if there is no cached decision
- Use customizable remediation priorities
- Determine AppSec (LAPI) remediation for a given request
- Determine AppSec (LAPI) remediation for a given request

- CrowdSec metrics
- Push usage metrics to LAPI

- Overridable cache handler (built-in support for `Redis`, `Memcached` and `PhpFiles` caches)


- Large PHP matrix compatibility: from 7.2 to 8.4


Expand Down Expand Up @@ -341,6 +344,16 @@ The `$rawBody` parameter is optional and must be used if the forwarded request c

Please see the [CrowdSec AppSec documentation](https://docs.crowdsec.net/docs/appsec/intro) for more details.

##### Push usage metrics to LAPI

To push usage metrics to LAPI, you can do the following call:

```php
$remediationEngine->pushUsageMetrics($bouncerName, $bouncerVersion, $bouncerType);
```

Metrics are retrieved from the cache and sent to LAPI.


#### Example scripts

Expand Down Expand Up @@ -437,6 +450,20 @@ php tests/scripts/get-remediation-appsec.php <APPSEC_URL> <IP> <URI> <HOST> <VER
php tests/scripts/get-appsec-remediation http://crowdsec:7422 172.0.0.24 /login example.com POST c580eb*********de541 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0' '{"Content-Type":"application/x-www-form-urlencoded","Accept-Language":"en-US,en;q=0.5"}' 'class.module.classLoader.resources.'
```

##### Push usage metrics to LAPI

###### Command usage

```php
php tests/scripts/push-lapi-usage-metrics.php <BOUNCER_KEY> <LAPI_URL>
```

###### Example usage

```bash
php tests/scripts/push-lapi-usage-metrics.php 68c2b479830c89bfd48926f9d764da39 https://crowdsec:8080
```


## CAPI remediation engine configurations

Expand Down Expand Up @@ -465,6 +492,18 @@ This setting is not required. If you don't set any value, `['ban']` will be used

In the example above, priorities can be summarized as `ban > captcha > bypass`.

### Bouncing level

```php
$configs = [
...
'bouncing_level' => 'normal_bouncing'
...
];
```

- `bouncing_level`: Select from `bouncing_disabled`, `normal_bouncing` or `flex_bouncing`. Choose if you want to apply CrowdSec directives (Normal bouncing) or be more permissive (Flex bouncing). With the `Flex mode`, it is impossible to accidentally block access to your site to people who don’t deserve it. This mode makes it possible to never ban an IP but only to offer a captcha, in the worst-case scenario.


### Remediation fallback

Expand Down Expand Up @@ -539,8 +578,7 @@ This setting is not required. If you don't set any value, `14400` (4h) will be u

The first parameter `$configs` of the `LapiRemediation` constructor can be used to pass some settings.

As for the CAPI remediation engine above, you can pass `ordered_remediations`, `fallback_remediation` and
`geolocation` settings.
As for the CAPI remediation engine above, you can pass `ordered_remediations`, `bouncing_level`, `fallback_remediation` and `geolocation` settings.

In addition, LAPI remediation engine handles the following settings:

Expand Down Expand Up @@ -744,10 +782,11 @@ the origin. When the retrieved remediation is a `bypass` (i.e. no active decisio
$originsCount = $remediation->getOriginsCount();

/*$originsCount = [
'appsec' => 6,
'clean' => 150,
'clean_appsec' => 2,
'capi' => 28,
'lists' => 16,
'appsec' => ['ban' => 10],
'clean' => ['bypass' =>150],
'clean_appsec' => ['bypass' =>2],
'CAPI' => ['ban' => 28],
'cscli' => ['ban' => 5, 'captcha' => 3],
'lists:tor' => ['custom' => 16],
]*/
```
Loading
Loading