-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Underestimation of consumables costs #1539
Comments
Current status of calibration (Areas that need addressing in //bold//)
|
Thanks @joehcollins and @EvaJanouskova or getting on the call just now. I'm adding the full list of consumables recorded as used in the model here - consumables_used_full_list_6dec2024.csv |
The undernutrition commodities may need to be looked up again, once the wasting module is in as the food supplements are there, and I can also add the Vit A (not included at the moment). @tdm32, is there Vit A logged with active measles cases (the guideline for management of acute malnutrition says it should be)? Regarding the hormonal methods expenditure, I'll need to look at this more closely. Will get back to you later on that. I think that Zinc and ORS sachet are related to diarrhoea module which is in @joehcollins' hands. |
Thanks @EvaJanouskova - That sounds good to wait for the wasting module before I check nutrition commodities again. |
Hi @EvaJanouskova yes Vit A is given to all with diagnosed measles infection |
@sakshimohan do you have the details on the simulation you used for these results - mainly population size? |
Hi @joehcollins The population size for the year I've used for validation (2018) is 18,253,723. This is the breakdown of the female population by age if helpful - |
sorry @sakshimohan i meant modelled individuals |
Ah got it. The modelled population was 125,544.8 in 2018. The simulation started with 100,000. |
Adding a summary of consumable availability by level and item code for reference here - consumable_availability_summary.csv |
@sakshimohan here are my initial thoughts on the consumables assigned to me. I think there are some actions we could take but might be good to meet and discuss this first?: Vincristin 1mg Injection:
Cyclophosphamide, 1 g
bleomycin powder 15 mg (15,000 IU) ()_1_IDA**
Catheter Foley's + urine bag (2000ml) 14g_1_CMST
Bandage, plaster of paris 15cm_12_CMST
Ampicillin injection 250mg, PFR_1_CMST
Benzylpenicillin 1g (1MU), PFR_1_CMST, Benzylpenicillin 3g (5MU), PFR_1_CMST
Gentamicin Sulphate 40mg/ml, 2ml_1_CMST
Flucloxacillin 250mg_100_CMST
Prednisolone 5mg_100_CMST
Salbutamol, tablet, 4 mg, Salbutamol, syrup, 2 mg/5 ml, Salbutamol sulphate 1mg/ml, 5ml_1_CMST
Tetracycline, tablet, 500 mg
Epinephrine, ampoule, 1 mg/ml
Ketamine, 10 ml vial, 50 mg/ml
Erythromycin, tablet, 250 mg
Insulin soluble 100 IU/ml, 10ml_1_CMST
Glibenclamide 5mg_1000_CMST
vitamin B12 (cyanocobalamine) 1 mg/ml, 1 ml, inj._100_IDA
Plaster of Paris (POP) 10cm x 7.5cm slab_12_CMST
|
PR #1543 addresses HIV test under-use |
PR Tara malaria cons fix dec2024 #1544 addresses the issues with malaria consumables noted here. We can have some further discussion on ITN logging and these changes (if needed) can be added to this PR also. |
@sakshimohan just summarising our call: 1.) Consumables to check if they are ever delivered in a model run - Flucloxacillin 250mg_100_CMST, Insulin soluble 100 IU/ml, 10ml_1_CMST, Glibenclamide 5mg_1000_CMST, Prednisolone 5mg_100_CMST 2.) Consumables which could be matched with other consumables that are being delivered - Bandage, plaster of paris 15cm_12_CMST, Ampicillin injection 250mg, PFR_1_CMST, Catheter Foley's + urine bag (2000ml) 14g_1_CMST |
@sakshimohan, Btw, are the costs generated by TLO for the same year, 2018? |
Yes Eva. That's right. |
I think this is because we do not distinguish between essential and non-essential items, which is causing the contraceptives not to be issued as often as they should be. (This would solve the issue #975.) |
Hi @sakshimohan , Could you please post here the job ID and the username of the person who send the job so I could look up what are the proportions of women on contraceptives? |
Hi @EvaJanouskova. This is based on draw 0 from the following job ID and username -
|
To get the proportions of women on contraceptives, I need to run this with contraception logging. @tdm32, is it the scenario: |
Hi @EvaJanouskova if you want the proportion of women on contraception in a baseline scenario with no interventions etc. you could run any analysis script, just keeping everything as default. |
Update on family planning commodities - Ideally, our cost estimate would be closer to $12.3 million, but this high estimate could also be due to over-supply of family planning commodities by donors. |
Hi @joehcollins I'm really sorry for the delay in getting back to you on these.
|
@joehcollins - on point 2, like you said on our call in December, these consumables have been registered as used by the model under a different name. So the good news is that these consumables are not completely ignored by the model. Some of the under-use seems to be arising from the item being requested but not being available. I'm wondering if the availability estimates are too low. I can explore alternative sources of availability data, if you think that might be the problem here.
|
on this point - i'm now no longer surprised insulin is not being administered as i think i'm not screening enough women for diabetes (working on this in another branch but we can make changes here if needed). For the other consumables (excluding Gliebn.) the availability may be too low? I'm quite shocked about Ampicillin and bandages! I dont think however you should change the availability unless theres good evidence to suggest its wrong...wondering if useful to have a call at some point to resolve these bits? |
Sounds good on insulin. If that branch in going into master eventually, that's perfect. Because this can wait until I rerun the costing estimates when the costing paper is potentially revised. On the availability of others, let me think of what might be the best solution. I'll write to you on Slack to set up a short call. |
As we discussed on slack:
But also the unit for Levonorgestrel was different at the time---cycle, ie 21 tablets. Implanon is covered by joined Jadelle or Implanon item |
@timcolbourn, @sakshimohan, Would you say it is close enough? The tablets and Jadelle seem a bit off, but it may be due to some other changes in the model. When I checked the proportions of women using the methods, those seemed fine. |
Thanks @EvaJanouskova yes I think it's close enough especially given what we have discussed and given the proportions of women using the methods seem fine. |
Many thanks for looking at your original logs, @EvaJanouskova. Certainly looks close enough to me. I'm happy to stick with the family planning commodity use as it stands right now. @joehcollins @tdm32 Is there any scope for dispensing condoms through your modules (only if it makes sense for your HSIs of course)? It seems like 107 million condoms were dispensed in Malawi in 2018 (as per LMIS). The model currently logs 12.5 million through Eva's family planning HSIs. |
I have data through the HIV program for 2021 which shows ~250,000 condoms distributed in that quarter, so maybe 1 million per year. I don't know how many were dispensed in previous years. We don't allocate any condoms through HSIs in the HIV module currently, even at this scale though, it won't come close to the targets. |
Currently we are underestimating the cost of consumables by $69 million or 38% of the 2018 expenditure reported in the Resource Mapping data.
This has occurred after merging in PR #1510 which updates the logging of consumables. This is likely because - i. we're not logging enough quantities of consumables
Used
for certain HSIs, ii. certain consumables are not included in the model at all. In order to expose this issue, I have compared -Items_Used
data to quantities dispensed reported in the OpenLMIS 2018 - The challenge with this is that we do not always know the units used in the OpenLMIS data so the focus here is to expose individual consumables which were dispensed as per OpenLMIS but not recorded as used in the TLO model.The .csv file attached below summarises some of the key consumables for which we might be underestimating the quantity of consumables needed.
pending_consumables_issues_4Dec2024.csv
The columns to focus on are -
This figure summarises the issue. Detailed table comparison TLO cost estimates with resource mapping data below.
The text was updated successfully, but these errors were encountered: