Re-Print: Developing and then Confirming a Hypothesis Based on a Chronology of Several Clinical Trials: A Bayesian Application to Pirfenidone Mortality Results

Research Article

Re-Print: Developing and then Confirming a Hypothesis Based on a Chronology of Several Clinical Trials: A Bayesian Application to Pirfenidone Mortality Results

  • Zhengning Lin * 1
  • Donald A Berry 2
  • 1 Ascendis Pharma, Palo Alto, CA, USA.
  • 2 Berry Consultants, Austin, TX, USA.

*Corresponding Author: Zhengning Lin, Ascendis Pharma Inc, 500 Emerson Street, Palo Alto, CA 94301, USA.

Citation: Z Lin and Donald A Berry. (2021) Re-Print: Developing and then Confirming a Hypothesis Based on a Chronology of Several Clinical Trials: A Bayesian Application to Pirfenidone Mortality Results. Biomedical Research and Clinical Reviews. 4(5); DOI: 10.31579/2692-9406/066

Copyright: © 2021 Zhengning Lin, This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Received: 11 May 2021 | Accepted: 06 September 2021 | Published: 15 September 2021

Keywords: hypothesis generation; hypothesis confirmation; historical data; rare disease; learn and confirm; idiopathic pulmonary fibrosis

Abstract

Designing a study for independent confirmation of a treatment effect is sometimes not practical due to required large sample size. Post hoc pooling of studies including those for learning purposes is subject to selection bias and therefore generally not suitable for confirmation of a treatment effect. We propose a Bayesian approach which calibrates the role of prior information from historical studies for learning and confirming purposes. The amount of prior information to be combined with current study data for the purpose of hypothesis confirmation depends on the overall strength of prior information for hypothesis generation. The method is illustrated in the analysis of mortality data for the pirfenidone NDA.

The Bayesian analysis provides a formal method to calibrate the role of information from historical evidence in the overall interpretation of results from both historical and concurrent clinical studies. The increased efficiency of using all available data is especially important in drug development for rare diseases with serious consequences, where limited patient source prohibits large trials, and unmet medical needs demand rapid access to treatment options.

Background

In clinical drug development, early phase studies are designed for learning, for generating and testing hypotheses. Later phase studies are designed for confirmation of treatment effects for regulatory approval. The process of developing and confirming hypotheses applies to a collection of several studies as well as individual studies. Earlier confirmatory studies may generate refined or new hypotheses to be confirmed by later confirmatory studies, and the cycle can go on and on.  The setting to confirm a hypothesis based on data exclusively from an individual study can be inefficient and sometimes not feasible in practice due to required large sample size, especially in the case of low event rate for a rare disease.  Although data pooling from multiple studies can provide reasonable sample size for hypothesis confirmation, post hoc data pooling including those for hypothesis generation purposes is not scientifically solid, and pre-specification of data pooling without early learning is often unrealistic.

Bayesian statistics has a natural framework to incorporate prior information from earlier studies, for the purpose of evaluating treatment effect from new study data. We propose a Bayesian approach which calibrates the role of prior information from earlier studies for learning and confirming purposes. It formally discount historical information for the purpose of confirming a treatment effect in a prospectively designed study.  This approach recognizes the hypothesis generation aspect of prior information while using the residual information for confirmation purposes with increased statistical efficiency.  Learning is viewed as continuum rather than regarding “study” to be the learning unit. We illustrate the method in the analysis of mortality data for the pirfenidone NDA.

To help readers with different professions to link Bayesian posterior probabilities to the widely used p-values, we use the term “analogous” to describe comparable levels of statistical significance between the two approaches of statistics. For example, a posterior probability of 0.975 for treatment benefit is analogous to a one-sided p-value of 0.025 (or a two sided p-value of 0.05) in terms of statistical significance, which is a conventional cut point for statistical significance in the current regulatory environment. This linkage is important to compare the two approaches of statistics with comparable level of statistical significance, although the meaning of posterior probabilities and p-values are quite different within each of the two approaches of statistics: “P = 0.025” is not interpreted as “the probability of alternative hypothesis is 0.975”, while the same data can produce a posterior probability of 0.975 for treatment benefit with a “non-informative” prior.

The Pirfenidone NDA

The pirfenidone NDA includes a total of three placebo-controlled studies to demonstrate efficacy for idiopathic pulmonary fibrosis (IPF), a rare and ultimately fatal lung disease with no treatment in the US at the time of NDA.  Studies PIPF-004 and PIPF-006 were conducted with a minimum of 72 weeks of double-blind placebo control, while Study PIPF-016 was a 52 week double-blind placebo controlled study started after completion of the early two studies.  The primary endpoint is percent predicted FVC, although mortality is considered as the ultimate endpoint with the limitation of low statistical power to be the primary endpoint.

The results of clinical studies PIPF-004 and PIPF-006 suggested that the evident slowing of disease progression caused by pirfenidone might translate into lower mortality. Therefore, the prospective plan of the subsequent confirmative study PIPF-016 included 52-week all-cause mortality and treatment-emergent IPF-related mortality as secondary endpoints. However, PIPF-016 was not powered to detect clinically important effects on either type of mortality. Assuming a total of 31 deaths from any cause (as actually observed in the study overall—refer to Table 1) and an eventual log-rank test, a large treatment effect with 0.5 hazard ratio has only 49% power to detect a treatment difference. Assuming a total of 10 treatment-emergent IPF-related deaths, the study has only 19% power with the same hazard ratio assumption.

Table 1:  Mortality data from Trials PIPF-016, PIPF-004 and PIPF-006 (All Randomized Patients)

To achieve greater power, the protocol and statistical analysis plan of PIPF-016 indicate that the events in PIPF-016 will be pooled with those censored at one year in PIPF-004 and PIPF-006. Results from the pooled analyses provide reasonably convincing evidence for a positive conclusion, as shown in Table 2.

Table 2: Mortality Data from PIPF-016, PIPF-004, and PIPF-006 Pooled (All Randomized Patients)

The consistency of the mortality results across the three trials as shown in Table 1 and the efficacy of pirfenidone in slowing the progression of IPF support a pooling strategy. However, there is a recognized limitation of the pooled mortality analysis because it was specified after results of the earlier trials were available, although before the start of PIPF-016. As a result patients in those two trials cannot be considered exchangeable with patients in trial PIPF-016 for the purpose of confirmation of treatment effect, as the earlier trials are partly hypothesis generating. 

A standard analysis for discounting prior information is via a Bayesian statistical approach [1]. The results of these earlier trials are relevant for addressing the final question, but at less than their face value. Hence in the context of trial PIPF-016 they should not count fully [2, 3]. 

Pooling of Mortality Data

In view of the limited power for addressing mortality in Study PIPF-016, the statistical analysis plan (SAP) for PIPF-016 prospectively defines a pooling analysis with the mortality information from Studies PIPF-006 and PIPF-004 as a secondary analysis:

Mortality data from Study PIPF-016 also will be pooled with data from the pirfenidone 2403 mg/d and placebo groups from Studies PIPF-004 and PIPF-006. For the pooled analysis, the PIPF-004 and PIPF-006 results will be censored at Study Day 365 if an event has not occurred earlier in order to allow the three studies to contribute comparable follow-up times to the pooled analysis.

The mortality analyses using the log-rank test described in the SAP for PIPF-016 provide p-values consistently less than 0.05 when using full pooling as shown in Table 2, while results based on PIPF-016 alone have p = 0.1045 for all-cause mortality and p = 0.2258 for treatment emergent IPF-related mortality.

We carried out a Bayesian analysis that discounts previous Studies PIPF-004 and PIPF-006 but borrows some inferential strength from these studies in estimating the effect of pirfenidone on reduction of mortality as compared with placebo for the PIPF-016 study [4, 5].

STATISTICAL MODELING

We use a Bayesian analysis to synthesize mortality results from Study PIPF-016 and the combination of Studies PIPF-004 and PIPF-006. The prospectively defined analysis for mortality endpoints in the statistical analysis plan for PIPF-016 was a time-to-event log-rank test of the hazard ratio. However, since the duration of follow-up is predetermined to be one year for all patients, we analyze the dichotomous outcomes of deaths within the first year. An advantage of using dichotomous outcomes (instead of time-to-event outcomes) is its simplicity of modeling with complete data transparency at each step of calculation, which is important for ease of communication of a complex concept to different professions. The approach to synthesize mortality data can be applied similarly to survival data with appropriate modeling.

Let the labels for Studies PIPF-004, PIPF-006, and PIPF-016 be = 4, 6, and 16, respectively. In study the number of subjects on placebo (PBO) is msand on pirfenidone (PIR) is ns. In study there are xs deaths in the PBO group and ys in the PIR group. We assume that the numbers of deaths within the PIR and PBO groups in study are distributed as binomial:  x_s~Binomial(m_s,p_s )

                                                                                                                                y_s~Binomial(n_s,q_s)            for = 4, 6, and 16.

In the Bayesian framework we can use the data from these historical studies to form a prior distribution on the mortality event rates for Study PIPF-016. The data from PIPF-016 can then be combined with the prior distribution formed from the historical study data to calculate the posterior distribution of the mortality event rates.

In the Bayesian framework we can use the data from these historical studies to form a prior distribution on the mortality event rates for Study PIPF-016. The data from PIPF-016 can then be combined with the prior distribution formed from the historical study data to calculate the posterior distribution of the mortality event rates.

Historical Prior

We assume beta prior distributions on the mortality event rates in Study PIPF-016: 

Equation 1

In particular, for both groups PBO and PIR we specify the borrowing of the historical data as a fraction borrowed parameter (θ) as: 

Equation 2

and 

Equation 3

where θ is a number between 0 and 1 to reflect the amount of borrowing of information between Study PIPF-016 and historical Studies PIPF-004 and PIPF-006. If θ = 1, then the historical studies are pooled with Study PIPF-016, whereas if θ = 0, then the historical data are completely discounted. The original prior, before any of the three studies, for both PIR and PBO is assumed to be a uniform distribution, with α0 = β0 = 1.

We use the symbol for the death rate for PIR in Study PIPF-016 and for the death rate on PBO, dropping the subscript 16 in both cases.

The prior distributions of and before Study PIPF-016 but after Studies PIPF-004 and PIPF-006 depend on θ. Figure 1 shows two special cases for all-cause mortality, one with θ = 1 and the other with θ = 0.50. In the case θ = 0, complete discounting of the earlier studies, both prior densities are uniform: equal to a constant for the whole interval from 0 to 1.

Figure 1: The Prior Densities for Pirfenidone (PIF) and Placebo (PBO) Using Full Borrowing and 50% Borrowing

Posterior Distribution: Updating Historical Prior with Study PIPF-016 Results

The posterior distribution of and given the results of PIPF-016 also has a beta distribution: 

Equation 4

Results

We provide results depending on θ, the amount of borrowing from PIPF-004 and PIPF-006. For each θ we draw 1 million samples from the posterior distributions of and and we report:

1) Posterior probability of superiority of PIR vs PBO (this is the proportion of samples where q < p>)

2) Posterior mean of the relative risk (q/p)

3) 95% credible interval of the relative risk

Table 3 shows results for both all-cause mortality and treatment-emergent IPF-related mortality.

Table 3: Mortality Results from Bayesian Analysis

All-cause Mortality

Under our Bayesian analysis and with no borrowing of information from PIPF-004 and PIPF-006, the posterior probability that pirfenidone is superior to placebo in terms of the all-cause mortality event rates is 0.951. This is analogous (in the sense of comparable statistical significance) to a one-sided p-value of 0.049 and a two-sided p-value of 0.098. In the other extreme, under full borrowing of information from PIPF-004 and PIPF-006, the posterior probability that PIR is superior to PBO in terms of all-cause mortality event rates is 0.9947. This is analogous to a one-sided p-value of 0.0053 and a two-sided p-value of 0.0106. This is very similar to the p-value under full pooling and the log-rank test on a time-to-event endpoint of 0.0107.

Figure 2 shows the probability of superiority for varying θ, reflecting a varying amount of borrowing from PIPF-004 and PIPF-006 as well as the estimated relative risks and 95% credible intervals for each. The figure shows that the “tipping point” where the probability of superiority is 0.975 (analogous to a one-sided p-value of 0.025) is θ = 0.29. So borrowing 29% or more of the mortality information from Studies PIPF-004 and PIPF-006 (which means discounting these two studies by 71% or less) gives statistical significance for all-cause mortality.

Figure 2: All-cause Mortality

Treatment-emergent IPF-related Mortality

Figure 3 shows similar results for event rates of treatment-emergent IPF-related mortality. In particular, under no borrowing of information from previous studies the posterior probability that PIR is superior to PBO is 0.89. At the other end of the scale, under full borrowing from Studies PIPF-004 and PIPF-006, the posterior probability that PIR is superior to PBO is 0.9975. The “tipping point” where the probability of superiority is 0.975 (analogous to a one-sided p-value of 0.025) is θ = 0.38. So borrowing 38% or more from Studies PIPF-004 and PIPF-006 (or discounting these two studies by 62% or less) gives statistical significance for treatment-emergent IPF-related mortality.

Figure 3: Treatment-emergent IPF-related Mortality

Calibrating the role of prior information

In view of limited power in assessing a possible reduction in mortality due to pirfenidone in comparison with placebo, the statistical analysis plan for Study PIPF-016 prospectively specified pooling the mortality results of PIPF-016 with those from two previous studies, PIPF-004 and PIPF-006. The mortality-related events in these previous studies was partially hypothesis generating. Our Bayesian analysis recognizes the hypothesis generating aspect of these earlier studies while using the residual information as a prior distribution for PIPF-016 by partially discounting the earlier studies.

Figure 4 shows this division into hypothesis-generating and confirmation. The former is shown in Panel A, showing 50% of the information in Studies PIPF-004 and PIPF-006. In Figure 4A the probability that pirfenidone is superior to placebo is 91%, which provides substantial motivation to establish the hypothesis that pirfenidone reduces all-cause mortality. For the prior distribution in Panel B for assessing all-cause mortality in Study PIPF-016 the posterior probability of superiority calculated in Figure 2 is 98.4%. The corresponding calculation for treatment-emergent IPF-related mortality in Figure 3 again assuming 50% use of results from Studies PIPF-004 and PIPF-006 is also 98.4%. The analogous two-sided p-value is 0.032. In both cases the results provide ample evidence of confirmation.

Figure 5 is in the same format as Figure 4. It shows the analogous parts of the information on all-cause mortality from Studies PIPF-004 and PIPF-006 at the tipping point of 71% of information for hypothesis generation and confirmation.

Figure 4: These Two Panels Show the Posterior Densities of the Results from Studies PIPF-004 and PIPF-006 (refer to Figure 1A) Divided in Two, Half for Hypothesis Generating (Panel A) and the Other Half to Serve as the Prior Information for Study PIPF-016 in Confirming the Hypothesis (Panel B)

The two graphs are identical to accentuate the equality of the information content in this division. In both panels the “numbers of deaths” are 5.5 out of 172.5 “patients” on PIR and 11 out of 173.5 “patients” on PBO. In Panel A, assuming a uniform distribution prior to studies PIPF-004 and PIPF-006, the probability that PIR is superior to PBO is 91%, which provides substantial motivation to establish the hypothesis that PIR reduces all-cause mortality. For the prior distribution in Panel B for assessing all-cause mortality in Study PIPF-016 the posterior probability of superiority calculated in Figure 2 is 98.4%. The corresponding calculation in Figure 3 again assuming 50% use of results from PIPF-004 and PIPF-006 is also 98.4%. PBO = placebo; PIR = pirfenidone.

Figure 5: This Figure Shows the Information Division between Hypothesis Generation and Hypothesis Confirmation at the “Tipping Point” Described in the Text 

The two panels show the posterior densities of the results from Studies PIPF-004 and PIPF-006 divided in two, 71% for hypothesis generating (Panel A) and the 29% to serve as the prior information for Study PIPF-016 in confirming the hypothesis (Panel B). In Panel A, assuming a uniform distribution prior to Studies PIPF-004 and PIPF-006, the probability that PIR is superior to placebo is 93.8%. Panel A contains more than twice as much information for hypothesis generation as Panel B does for confirmation. In Panel A the “numbers of deaths” are 7.81 out of 244.95 “patients” on PIR and 15.62 out of 246.37 “patients” on PBO. In Panel B the “numbers of deaths” are 3.19 out of 100.05 “patients” on PIR and 6.38 out of 100.63 “patients” on PBO. PBO = placebo; PIR = pirfenidone.

An example of a Bayesian analysis using 50% borrowing from a previous study in a registration setting is Boston Scientific’s WATCHMAN® Left Atrial Appendage Closure Therapy (FDA, 2013)6.

The prior distributions in this Bayesian analysis are empirically based. Berry et al. [3], Berry [7] describe how to use other available information subjectively to improve the accuracy of Bayesian conclusions. For example, the effectiveness of pirfenidone in shifting the stage of IPF may be reasonably regarded to result in an end-stage shift, that is, a mortality reduction. Evidence for this possibility and other information can be incorporated into the prior distributions of this report using methods described in these references.

In summary, a helpful feature of the Bayesian analysis described above is that it provides a way to calibrate the role of the information from the earlier studies in the overall interpretation of the results from all studies. The range of this calibration includes no use of the information from the previous studies at one end and full use of the previous studies in a pooled analysis at the opposite end. The middle ground with respect to the calibration provides a reasonably convincing basis for a positive conclusion with respect to the totality of information from all three studies. Discussions to determine an appropriate amount to borrow from previous studies are included in the following section.

Discussion

Borrowing information

Borrowing information from prior studies to confirm treatment effect becomes increasingly important in drug development, especially in the field of rare disease, with opportunities of increased efficiency of delivering effective treatments to patients.  In many cases, combining information from multiple studies is the only way practical to confirm treatment effect, like the case of mortality data for pirfenidone8. The Bayesian mortality analysis for pirfenidone illustrated how information from prior studies can be formally incorporated to confirm efficacy for a prospectively designed study not independently capable for such confirmation. It discounted prior study data to account for its hypothesis generating aspect without ignoring the information for the purpose of hypothesis confirmation.

The appropriate amount to borrow (θ) depends on if the discounted amount (1- θ) reasonably establishes the treatment benefit as a hypothesis to be confirmed. The Bayesian calculation translates this concept into the probability of treatment benefit based on the discounted fraction of previous study data. If the probability is large enough to establish the hypothesis, such as 90%, then the residual fraction from previous studies can be borrowed and integrated with new study data for independent hypothesis confirmation.

Determining an appropriate amount to borrow requires subjective judgement. There is no established convention to determine if a particular probability, say, 60%, is considered large enough to establish a hypothesis. Without additional information (such as data of reliable biomarkers), a default probability value of 90% should be sufficient for the purpose of generating hypotheses. The actual discount may be adjusted with a different corresponding probability than 90

Conclusion

The Bayesian analysis provides a formal method to calibrate the role of information from historical evidence in the overall interpretation of results from both historical and concurrent clinical studies. The increased efficiency of using all available data is especially important in drug development for rare diseases with serious consequences, where limited patient source prohibits large trials, and unmet medical needs demand rapid access to treatment options. This Bayesian application illustrates that when results from historical studies are compelling, independent confirmation of treatment effect can be achieved more efficiently using a statistical integration of current and historical studies.

References

Clearly Auctoresonline and particularly Psychology and Mental Health Care Journal is dedicated to improving health care services for individuals and populations. The editorial boards' ability to efficiently recognize and share the global importance of health literacy with a variety of stakeholders. Auctoresonline publishing platform can be used to facilitate of optimal client-based services and should be added to health care professionals' repertoire of evidence-based health care resources.

img

Virginia E. Koenig

Journal of Clinical Cardiology and Cardiovascular Intervention The submission and review process was adequate. However I think that the publication total value should have been enlightened in early fases. Thank you for all.

img

Delcio G Silva Junior

Journal of Women Health Care and Issues By the present mail, I want to say thank to you and tour colleagues for facilitating my published article. Specially thank you for the peer review process, support from the editorial office. I appreciate positively the quality of your journal.

img

Ziemlé Clément Méda

Journal of Clinical Research and Reports I would be very delighted to submit my testimonial regarding the reviewer board and the editorial office. The reviewer board were accurate and helpful regarding any modifications for my manuscript. And the editorial office were very helpful and supportive in contacting and monitoring with any update and offering help. It was my pleasure to contribute with your promising Journal and I am looking forward for more collaboration.

img

Mina Sherif Soliman Georgy

We would like to thank the Journal of Thoracic Disease and Cardiothoracic Surgery because of the services they provided us for our articles. The peer-review process was done in a very excellent time manner, and the opinions of the reviewers helped us to improve our manuscript further. The editorial office had an outstanding correspondence with us and guided us in many ways. During a hard time of the pandemic that is affecting every one of us tremendously, the editorial office helped us make everything easier for publishing scientific work. Hope for a more scientific relationship with your Journal.

img

Layla Shojaie

The peer-review process which consisted high quality queries on the paper. I did answer six reviewers’ questions and comments before the paper was accepted. The support from the editorial office is excellent.

img

Sing-yung Wu

Journal of Neuroscience and Neurological Surgery. I had the experience of publishing a research article recently. The whole process was simple from submission to publication. The reviewers made specific and valuable recommendations and corrections that improved the quality of my publication. I strongly recommend this Journal.

img

Orlando Villarreal

Dr. Katarzyna Byczkowska My testimonial covering: "The peer review process is quick and effective. The support from the editorial office is very professional and friendly. Quality of the Clinical Cardiology and Cardiovascular Interventions is scientific and publishes ground-breaking research on cardiology that is useful for other professionals in the field.

img

Katarzyna Byczkowska

Thank you most sincerely, with regard to the support you have given in relation to the reviewing process and the processing of my article entitled "Large Cell Neuroendocrine Carcinoma of The Prostate Gland: A Review and Update" for publication in your esteemed Journal, Journal of Cancer Research and Cellular Therapeutics". The editorial team has been very supportive.

img

Anthony Kodzo-Grey Venyo

Testimony of Journal of Clinical Otorhinolaryngology: work with your Reviews has been a educational and constructive experience. The editorial office were very helpful and supportive. It was a pleasure to contribute to your Journal.

img

Pedro Marques Gomes

Dr. Bernard Terkimbi Utoo, I am happy to publish my scientific work in Journal of Women Health Care and Issues (JWHCI). The manuscript submission was seamless and peer review process was top notch. I was amazed that 4 reviewers worked on the manuscript which made it a highly technical, standard and excellent quality paper. I appreciate the format and consideration for the APC as well as the speed of publication. It is my pleasure to continue with this scientific relationship with the esteem JWHCI.

img

Bernard Terkimbi Utoo

This is an acknowledgment for peer reviewers, editorial board of Journal of Clinical Research and Reports. They show a lot of consideration for us as publishers for our research article “Evaluation of the different factors associated with side effects of COVID-19 vaccination on medical students, Mutah university, Al-Karak, Jordan”, in a very professional and easy way. This journal is one of outstanding medical journal.

img

Prof Sherif W Mansour

Dear Hao Jiang, to Journal of Nutrition and Food Processing We greatly appreciate the efficient, professional and rapid processing of our paper by your team. If there is anything else we should do, please do not hesitate to let us know. On behalf of my co-authors, we would like to express our great appreciation to editor and reviewers.

img

Hao Jiang

As an author who has recently published in the journal "Brain and Neurological Disorders". I am delighted to provide a testimonial on the peer review process, editorial office support, and the overall quality of the journal. The peer review process at Brain and Neurological Disorders is rigorous and meticulous, ensuring that only high-quality, evidence-based research is published. The reviewers are experts in their fields, and their comments and suggestions were constructive and helped improve the quality of my manuscript. The review process was timely and efficient, with clear communication from the editorial office at each stage. The support from the editorial office was exceptional throughout the entire process. The editorial staff was responsive, professional, and always willing to help. They provided valuable guidance on formatting, structure, and ethical considerations, making the submission process seamless. Moreover, they kept me informed about the status of my manuscript and provided timely updates, which made the process less stressful. The journal Brain and Neurological Disorders is of the highest quality, with a strong focus on publishing cutting-edge research in the field of neurology. The articles published in this journal are well-researched, rigorously peer-reviewed, and written by experts in the field. The journal maintains high standards, ensuring that readers are provided with the most up-to-date and reliable information on brain and neurological disorders. In conclusion, I had a wonderful experience publishing in Brain and Neurological Disorders. The peer review process was thorough, the editorial office provided exceptional support, and the journal's quality is second to none. I would highly recommend this journal to any researcher working in the field of neurology and brain disorders.

img

Dr Shiming Tang

Dear Agrippa Hilda, Journal of Neuroscience and Neurological Surgery, Editorial Coordinator, I trust this message finds you well. I want to extend my appreciation for considering my article for publication in your esteemed journal. I am pleased to provide a testimonial regarding the peer review process and the support received from your editorial office. The peer review process for my paper was carried out in a highly professional and thorough manner. The feedback and comments provided by the authors were constructive and very useful in improving the quality of the manuscript. This rigorous assessment process undoubtedly contributes to the high standards maintained by your journal.

img

Raed Mualem

International Journal of Clinical Case Reports and Reviews. I strongly recommend to consider submitting your work to this high-quality journal. The support and availability of the Editorial staff is outstanding and the review process was both efficient and rigorous.

img

Andreas Filippaios

Thank you very much for publishing my Research Article titled “Comparing Treatment Outcome Of Allergic Rhinitis Patients After Using Fluticasone Nasal Spray And Nasal Douching" in the Journal of Clinical Otorhinolaryngology. As Medical Professionals we are immensely benefited from study of various informative Articles and Papers published in this high quality Journal. I look forward to enriching my knowledge by regular study of the Journal and contribute my future work in the field of ENT through the Journal for use by the medical fraternity. The support from the Editorial office was excellent and very prompt. I also welcome the comments received from the readers of my Research Article.

img

Dr Suramya Dhamija

Dear Erica Kelsey, Editorial Coordinator of Cancer Research and Cellular Therapeutics Our team is very satisfied with the processing of our paper by your journal. That was fast, efficient, rigorous, but without unnecessary complications. We appreciated the very short time between the submission of the paper and its publication on line on your site.

img

Bruno Chauffert

I am very glad to say that the peer review process is very successful and fast and support from the Editorial Office. Therefore, I would like to continue our scientific relationship for a long time. And I especially thank you for your kindly attention towards my article. Have a good day!

img

Baheci Selen

"We recently published an article entitled “Influence of beta-Cyclodextrins upon the Degradation of Carbofuran Derivatives under Alkaline Conditions" in the Journal of “Pesticides and Biofertilizers” to show that the cyclodextrins protect the carbamates increasing their half-life time in the presence of basic conditions This will be very helpful to understand carbofuran behaviour in the analytical, agro-environmental and food areas. We greatly appreciated the interaction with the editor and the editorial team; we were particularly well accompanied during the course of the revision process, since all various steps towards publication were short and without delay".

img

Jesus Simal-Gandara

I would like to express my gratitude towards you process of article review and submission. I found this to be very fair and expedient. Your follow up has been excellent. I have many publications in national and international journal and your process has been one of the best so far. Keep up the great work.

img

Douglas Miyazaki

We are grateful for this opportunity to provide a glowing recommendation to the Journal of Psychiatry and Psychotherapy. We found that the editorial team were very supportive, helpful, kept us abreast of timelines and over all very professional in nature. The peer review process was rigorous, efficient and constructive that really enhanced our article submission. The experience with this journal remains one of our best ever and we look forward to providing future submissions in the near future.

img

Dr Griffith

I am very pleased to serve as EBM of the journal, I hope many years of my experience in stem cells can help the journal from one way or another. As we know, stem cells hold great potential for regenerative medicine, which are mostly used to promote the repair response of diseased, dysfunctional or injured tissue using stem cells or their derivatives. I think Stem Cell Research and Therapeutics International is a great platform to publish and share the understanding towards the biology and translational or clinical application of stem cells.

img

Dr Tong Ming Liu

I would like to give my testimony in the support I have got by the peer review process and to support the editorial office where they were of asset to support young author like me to be encouraged to publish their work in your respected journal and globalize and share knowledge across the globe. I really give my great gratitude to your journal and the peer review including the editorial office.

img

Husain Taha Radhi

I am delighted to publish our manuscript entitled "A Perspective on Cocaine Induced Stroke - Its Mechanisms and Management" in the Journal of Neuroscience and Neurological Surgery. The peer review process, support from the editorial office, and quality of the journal are excellent. The manuscripts published are of high quality and of excellent scientific value. I recommend this journal very much to colleagues.

img

S Munshi

Dr.Tania Muñoz, My experience as researcher and author of a review article in The Journal Clinical Cardiology and Interventions has been very enriching and stimulating. The editorial team is excellent, performs its work with absolute responsibility and delivery. They are proactive, dynamic and receptive to all proposals. Supporting at all times the vast universe of authors who choose them as an option for publication. The team of review specialists, members of the editorial board, are brilliant professionals, with remarkable performance in medical research and scientific methodology. Together they form a frontline team that consolidates the JCCI as a magnificent option for the publication and review of high-level medical articles and broad collective interest. I am honored to be able to share my review article and open to receive all your comments.

img

Tania Munoz

“The peer review process of JPMHC is quick and effective. Authors are benefited by good and professional reviewers with huge experience in the field of psychology and mental health. The support from the editorial office is very professional. People to contact to are friendly and happy to help and assist any query authors might have. Quality of the Journal is scientific and publishes ground-breaking research on mental health that is useful for other professionals in the field”.

img

George Varvatsoulias

Dear editorial department: On behalf of our team, I hereby certify the reliability and superiority of the International Journal of Clinical Case Reports and Reviews in the peer review process, editorial support, and journal quality. Firstly, the peer review process of the International Journal of Clinical Case Reports and Reviews is rigorous, fair, transparent, fast, and of high quality. The editorial department invites experts from relevant fields as anonymous reviewers to review all submitted manuscripts. These experts have rich academic backgrounds and experience, and can accurately evaluate the academic quality, originality, and suitability of manuscripts. The editorial department is committed to ensuring the rigor of the peer review process, while also making every effort to ensure a fast review cycle to meet the needs of authors and the academic community. Secondly, the editorial team of the International Journal of Clinical Case Reports and Reviews is composed of a group of senior scholars and professionals with rich experience and professional knowledge in related fields. The editorial department is committed to assisting authors in improving their manuscripts, ensuring their academic accuracy, clarity, and completeness. Editors actively collaborate with authors, providing useful suggestions and feedback to promote the improvement and development of the manuscript. We believe that the support of the editorial department is one of the key factors in ensuring the quality of the journal. Finally, the International Journal of Clinical Case Reports and Reviews is renowned for its high- quality articles and strict academic standards. The editorial department is committed to publishing innovative and academically valuable research results to promote the development and progress of related fields. The International Journal of Clinical Case Reports and Reviews is reasonably priced and ensures excellent service and quality ratio, allowing authors to obtain high-level academic publishing opportunities in an affordable manner. I hereby solemnly declare that the International Journal of Clinical Case Reports and Reviews has a high level of credibility and superiority in terms of peer review process, editorial support, reasonable fees, and journal quality. Sincerely, Rui Tao.

img

Rui Tao

Clinical Cardiology and Cardiovascular Interventions I testity the covering of the peer review process, support from the editorial office, and quality of the journal.

img

Khurram Arshad

Clinical Cardiology and Cardiovascular Interventions, we deeply appreciate the interest shown in our work and its publication. It has been a true pleasure to collaborate with you. The peer review process, as well as the support provided by the editorial office, have been exceptional, and the quality of the journal is very high, which was a determining factor in our decision to publish with you.

img

Gomez Barriga Maria Dolores

The peer reviewers process is quick and effective, the supports from editorial office is excellent, the quality of journal is high. I would like to collabroate with Internatioanl journal of Clinical Case Reports and Reviews journal clinically in the future time.

img

Lin Shaw Chin

Clinical Cardiology and Cardiovascular Interventions, I would like to express my sincerest gratitude for the trust placed in our team for the publication in your journal. It has been a true pleasure to collaborate with you on this project. I am pleased to inform you that both the peer review process and the attention from the editorial coordination have been excellent. Your team has worked with dedication and professionalism to ensure that your publication meets the highest standards of quality. We are confident that this collaboration will result in mutual success, and we are eager to see the fruits of this shared effort.

img

Maria Dolores Gomez Barriga

Dear Dr. Jessica Magne, Editorial Coordinator 0f Clinical Cardiology and Cardiovascular Interventions, I hope this message finds you well. I want to express my utmost gratitude for your excellent work and for the dedication and speed in the publication process of my article titled "Navigating Innovation: Qualitative Insights on Using Technology for Health Education in Acute Coronary Syndrome Patients." I am very satisfied with the peer review process, the support from the editorial office, and the quality of the journal. I hope we can maintain our scientific relationship in the long term.

img

Dr Maria Dolores Gomez Barriga

Dear Monica Gissare, - Editorial Coordinator of Nutrition and Food Processing. ¨My testimony with you is truly professional, with a positive response regarding the follow-up of the article and its review, you took into account my qualities and the importance of the topic¨.

img

Dr Maria Regina Penchyna Nieto

Dear Dr. Jessica Magne, Editorial Coordinator 0f Clinical Cardiology and Cardiovascular Interventions, The review process for the article “The Handling of Anti-aggregants and Anticoagulants in the Oncologic Heart Patient Submitted to Surgery” was extremely rigorous and detailed. From the initial submission to the final acceptance, the editorial team at the “Journal of Clinical Cardiology and Cardiovascular Interventions” demonstrated a high level of professionalism and dedication. The reviewers provided constructive and detailed feedback, which was essential for improving the quality of our work. Communication was always clear and efficient, ensuring that all our questions were promptly addressed. The quality of the “Journal of Clinical Cardiology and Cardiovascular Interventions” is undeniable. It is a peer-reviewed, open-access publication dedicated exclusively to disseminating high-quality research in the field of clinical cardiology and cardiovascular interventions. The journal's impact factor is currently under evaluation, and it is indexed in reputable databases, which further reinforces its credibility and relevance in the scientific field. I highly recommend this journal to researchers looking for a reputable platform to publish their studies.

img

Dr Marcelo Flavio Gomes Jardim Filho

Dear Editorial Coordinator of the Journal of Nutrition and Food Processing! "I would like to thank the Journal of Nutrition and Food Processing for including and publishing my article. The peer review process was very quick, movement and precise. The Editorial Board has done an extremely conscientious job with much help, valuable comments and advices. I find the journal very valuable from a professional point of view, thank you very much for allowing me to be part of it and I would like to participate in the future!”

img

Zsuzsanna Bene

Dealing with The Journal of Neurology and Neurological Surgery was very smooth and comprehensive. The office staff took time to address my needs and the response from editors and the office was prompt and fair. I certainly hope to publish with this journal again.Their professionalism is apparent and more than satisfactory. Susan Weiner

img

Dr Susan Weiner

My Testimonial Covering as fellowing: Lin-Show Chin. The peer reviewers process is quick and effective, the supports from editorial office is excellent, the quality of journal is high. I would like to collabroate with Internatioanl journal of Clinical Case Reports and Reviews.

img

Lin-Show Chin

My experience publishing in Psychology and Mental Health Care was exceptional. The peer review process was rigorous and constructive, with reviewers providing valuable insights that helped enhance the quality of our work. The editorial team was highly supportive and responsive, making the submission process smooth and efficient. The journal's commitment to high standards and academic rigor makes it a respected platform for quality research. I am grateful for the opportunity to publish in such a reputable journal.

img

Sonila Qirko

My experience publishing in International Journal of Clinical Case Reports and Reviews was exceptional. I Come forth to Provide a Testimonial Covering the Peer Review Process and the editorial office for the Professional and Impartial Evaluation of the Manuscript.

img

Luiz Sellmann