Existence of solutions for perturbed fractional equations with two competing weighted nonlinear terms

Abstract

This paper deals with a perturbed nonlocal equation of fractional Laplacian type involving two competing nonlinear terms with weights f and h. Under two kinds of integrability conditions on the ratio of f to h, we show some different existence results in this setting by using variational methods. Our results are extension of some problems studied by Carboni and Mugnai (J. Differ. Equ. 262(3):2393–2413, 2017) and Xiang et al. (J. Differ. Equ. 260(2):1392–1413, 2016).

1 Introduction and main results

The aim of this paper is to derive the existence and multiplicity of nontrivial solutions for the following one-parameter perturbed nonlocal problem:

where $\lambda\in\mathbb{R}$, $0< s<1$, $\Omega\subset\mathbb{R}^{N}$ is a bounded domain with Lipschitz boundary, $N>2s$. Here $(-\Delta)^{s}$ is the fractional Laplacian operator defined, up to a normalization factor, by

$$(-\Delta)^{s}u(x)=-\frac{1}{2} \int_{\mathbb{R}^{N}}\frac {u(x+y)+u(x-y)-2u(x)}{|y|^{N+2s}}\,dy,\quad x\in\mathbb{R}^{N}, $$

along any rapidly decaying function u of class $C^{\infty}(\mathbb {R}^{N})$; see [2]. Such operators arise in a quite natural way in many different contexts, such as the thin obstacle problem, optimization, finance, probability, and materials science (see [3–6]).

In recent years, great attention has been focused on the study of the problems involving fractional operators, both for pure mathematical research and for concrete applications. Here we only collect some results for problems with two competing nonlinear terms. Local problems with combined effect of convex and concave nonlinearities have been widely investigated in the past decades; see, for example, [7–12]. In particular, Alama and Tarantello [10] considered the convex–concave Dirichlet problem

$$\textstyle\begin{cases} -\Delta u =\lambda u+f(x)u^{q-1}-h(x)u^{r-1} &\mbox{in } \Omega, \\ u >0 &\mbox{in } \Omega, \\ u =0 &\mbox{on } \partial\Omega, \end{cases} $$

where $2< q< r$, and f and h are nonnegative weights. They first proved that the existence and multiplicity of solutions depend both on λ and the integrability of a certain ratio of f to h. Related problems with a perturbed term in the whole space were treated by Autuori and Pucci [12], who studied the following quasilinear equation:

$$-\operatorname{div}\bigl(|\nabla u|^{p-2}\nabla u\bigr)+a(x)|u|^{p-2}u= \lambda f(x)|u|^{q-2}u-h(x)|u|^{r-2}u\quad \mbox{in } \mathbb{R}^{N}, $$

where $\max\{2,p\}< q<\min \{r,\frac{pN}{N-p} \}$, and the weights f and h are related by the integrability condition $(\frac{f^{r}}{h^{q}} )^{\frac{1}{r-q}}\in L^{1}(\mathbb{R}^{N})$. After that, in [13], they extended these results to a nonlocal problem involving the fractional Laplacian and indicated that it is still an open problem when the integrability condition on f and h is replaced by the weaker assumption $(\frac{f^{r-2}}{h^{q-2}} )^{\frac{1}{r-q}}\in L^{\frac {N}{2s}}(\mathbb{R}^{N})$. Xiang et al. [1] gave a positive answer to this open problem in the setting of fractional p-Laplacian in $\mathbb{R}^{N}$. In these papers, to obtain the existence of solutions, the authors assume that perturbed weights $a(x)$ are bounded below by positive constants or positive functions.

All these problems involve convex–concave nonlinearities. Rǎdulescu and Repovš [11] dealt with the concave–concave Dirichlet problem without perturbed term in a bounded domain:

$$ \textstyle\begin{cases} -\Delta u =\lambda f(x)u^{q-1}-h(x)u^{r-1}& \mbox{in } \Omega, \\ u >0 &\mbox{in } \Omega, \\ u =0 &\mbox{on } \partial\Omega. \end{cases} $$

(1.1)

Assuming that $1< q<2<r<\frac{2N}{N-2}$ and $f,h\in L^{\infty}$ are such that $\operatorname{ess}\inf_{x\in\Omega} f(x)>0$ and $\operatorname{ess}\inf_{x\in \Omega} h(x)>0$, they proved the nonexistence and multiplicity of solutions with respect to the different range of λ. When $f(x)\equiv1$ in Ω, a nonlocal version of problem (1.1) involving the square root of Laplacian ($s=\frac{1}{2}$) was studied in [14] with $1< q< r<2_{s}^{*}=\frac{2N}{N-2s}$, $h\in L^{\frac {q}{q-r}}(\Omega)$, and $h\in L^{\sigma}(\Omega)$, $\sigma>\frac {2_{s}^{*}}{2_{s}^{*}-r}$.

The equation considered in problem (${P}_{\lambda }$) is in spirit of the previous papers, even if most of them deal with problem not directly comparable to ours. The nonlinear terms in (${P}_{\lambda }$) are related to the main elliptic part by requesting that:

(H₁):

g is a Carathéodory function, and there exist two positive constants $b_{1}$ and $b_{2}$ such that

$$ b_{1}|t|^{r}\leq g(x,t)t\leq b_{2}|t|^{r}\quad \mbox{for a.e. } x\in\Omega \mbox{ and all } t\in\mathbb{R}, $$

(1.2)

where $1< q< r<2_{s}^{*}$, and $2^{*}_{s}= \frac{2N}{N-2s}$ is the Sobolev fractional critical exponent;

(H₂):

$f,h:\Omega\rightarrow\mathbb{R}_{+}$ are positive weights satisfying $f\in L^{\frac{2_{s}^{*}}{2_{s}^{*}-q}}(\Omega)$ and $h\in L^{\frac{2_{s}^{*}}{2_{s}^{*}-r}}(\Omega)$. Moreover, $f(x)$ and $h(x)$ are related by the condition

$$ \biggl(\frac{f^{r}}{h^{q}} \biggr)^{\frac {1}{r-q}}\in L^{1}(\Omega); $$

(1.3)

(H₃):

$v:\Omega\rightarrow\mathbb{R}$ is a perturbed weight such that $v(x)\geq0$ for a.e. $x\in\Omega$.

We now state our main results. Our first result covers both convex–concave and concave–concave cases.

Theorem 1.1

Suppose that assumptions (H₁)–(H₃) are satisfied. Then there exist three numbers $\lambda^{*}\geq\lambda _{*}\geq\lambda_{0}\geq0$ such that problem (${P}_{\lambda }$) has

• (i) only the trivial solution if $\lambda<\lambda_{0}$;

• (ii) at least one nontrivial solution of definite sign if $\lambda>\lambda_{*}$;

• (iii) at least two nontrivial solutions if $\lambda>\lambda^{*}$; one them is positive, and one is negative.

As $q>2$, we replace (1.3) by the assumption

$$ \biggl(\frac{f^{r-2}}{h^{q-2}} \biggr)^{\frac{1}{r-q}}\in L^{\frac {N}{2s}}(\Omega). $$

(1.4)

Note that thanks to $q<2^{*}_{s}$, by the Hölder’s inequality we have

$$ \biggl\Vert \biggl(\frac{f^{r-2}}{h^{q-2}} \biggr)^{\frac{1}{r-q}} \biggr\Vert _{L^{\frac{N}{2s}}(\Omega)}\leq\|f\|_{L^{\frac {2_{s}^{*}}{{2_{s}^{*}}-q}}(\Omega)}^{\frac{2}{q}} \biggl\Vert \biggl( \frac{f^{r}}{h^{q}} \biggr)^{\frac{1}{r-q}} \biggr\Vert _{L^{1}(\Omega)}^{1-\frac{2}{q}}, $$

which means that requirement (1.4) is weaker than (1.3) (see also [1, 13]). In this situation, we relabel (H₂) as ($\mathrm{H}_{2}'$). We state some improved results as follows.

Theorem 1.2

Let $2< q< r<2_{s}^{*}$ and suppose that (1.2), ($\mathrm{H}_{2}'$), and (H₃) hold. Then

• (i) the results of Theorem 1.1 still hold, and the number $\lambda_{0}>0$;

• (ii) if $\lambda=\lambda_{0}$, then problem (${P}_{\lambda }$) has at least one nontrivial solution; if $\lambda=\lambda_{*}$, then problem (${P}_{\lambda }$) has at least one nontrivial solution of definite sign; if $\lambda=\lambda^{*}$, then problem (${P}_{\lambda }$) has at least two nontrivial solutions; one of them is positive, and one is negative;

• (iii) there exist a number $\tilde{\lambda }\geq\lambda^{*}$ such that problem (${P}_{\lambda }$) has at least four nontrivial solutions for every $\lambda\geq\tilde{\lambda }$; two of them are positive, and two are negative.

Our work are an extension of problems studied in [14], where $s=\frac{1}{2}$, $f(x)\equiv1$, and $v(x)\equiv0$. Even in this case, our assumptions on $h(x)$ are weaker than those in [14] since $h\in L^{\frac{2_{s}^{*}}{2_{s}^{*}-r}}(\Omega)$, which is allowed to satisfy condition (1.4) here. On the other hand, the problem studied in this paper covers both convex–concave and concave–concave cases, and owing to the different approach used here, the assumptions on perturbed weight can be relaxed to be nonnegative. From this point, our results extend some results of [1]. In addition, using variational methods, we present more complete results in the convex–concave case by describing the problem at all threshold values $\lambda_{0}$, $\lambda _{*}$, $\lambda^{*}$, and λ̃.

Many other types of fractional and nonlocal problems are also actively studied in recent years. For example, we refer to [15–21] for fractional Kirchhof-type problems. Studies of fractional Schrödinger problems can be found in [22–24]. Fractional problems with special nonlinearities have been considered in [25–27]. Results on the Brézis–Nirenberg problem for a fractional operator were presented in [28, 29].

The remaining of this paper is organized as follows. In Sect. 2, we recall some preliminary results and main embedding results for fractional Sobolev spaces. In Sect. 3 and 4, we prove Theorems 1.1 and 1.2, respectively.

2 Preliminaries

In this section, we recall some necessary definitions and properties of the fractional Laplacian operator. For further details, we refer to [2, 30, 31] and references therein.

We denote by $H^{s}(\mathbb{R}^{N})$ the classical fractional Sobolev space with the Gagliardo norm

$$\|u\|_{H^{s}(\mathbb{R}^{N})}=\|u\|_{L^{2}(\mathbb{R}^{N})}+ \biggl( \iint _{\mathbb{R}^{2N}} \frac{|u(x)-u(y)|^{2}}{|x-y|^{N+2s}}\,dx\,dy \biggr)^{\frac{1}{2}}. $$

For a detailed account on the properties of $H^{s}(\mathbb{R}^{N})$, we refer to [2]. In this paper, we consider the closed linear subspace

$$X_{0}^{s}(\Omega)=\bigl\{ u\in H^{s}\bigl( \mathbb{R}^{N}\bigr):u(x)=0 \mbox{ for a.e. } x\in \mathbb{R}^{N} \setminus\Omega\bigr\} $$

with the norm

$$\|u\|_{X_{0}^{s}(\Omega)}= \biggl( \iint_{\mathbb{R}^{2N}} \frac{|u(x)-u(y)|^{2}}{|x-y|^{N+2s}}\,dx\,dy \biggr)^{\frac{1}{2}}, $$

which is equivalent to its general norm (see [2], Theorem 7.1). Then $X_{0}^{s}(\Omega)$ is a Hilbert space. Let the space E denote the completion of $C_{0}^{\infty}({\Omega})$ with respect to the norm

$$\|u\|_{E}= \biggl(\|u\|^{2}_{X_{0}^{s}(\Omega)}+ \int_{\Omega}v(x) \bigl\vert u(x) \bigr\vert ^{2} \,dx \biggr)^{\frac{1}{2}}. $$

It is readily seen that E is a convex Banach space with scalar product

$$\langle u,\varphi\rangle_{E}= \iint_{\mathbb{R}^{2N}} \frac{(u(x)-u(y))(\varphi(x)-\varphi(y))}{|x-y|^{N+2s}}\,dx\,dy+ \int_{\Omega}v(x) u(x)\varphi(x)\,dx $$

and has the following embedding property.

Lemma 2.1

Let $1\leq\theta\leq2^{*}_{s}$. Then we have the continuous embedding

$$E\hookrightarrow L^{\theta}(\Omega), $$

and there exists constants $C_{\theta}$ such that

$$\|u\|_{\theta}\leq C_{\theta}\|u\|_{E}\quad \textit{for all }u\in E. $$

In particular, for $\theta\in[1,2^{*}_{s})$, the embedding is compact.

Proof

It is easy to see that the embedding $E\hookrightarrow X_{0}^{s}(\Omega)$ is continuous with $\|u\|_{X_{0}^{s}(\Omega)}\leq\| u\|_{E}$. By Theorem 7.1 in [2] the embedding $X_{0}^{s}(\Omega )\hookrightarrow L^{\theta}(\Omega)$ is continuous for all $1\leq\theta\leq2^{*}_{s}$ with

$$\|u\|_{\theta}\leq C_{\theta}\|u\|_{X_{0}^{s}({\Omega})}, $$

where $C_{\theta}$ is a positive constant. Moreover, the embedding is compact when $\theta\in[1,2^{*}_{s})$. So, we get the claim. □

On the other hand, for any $r,q\geq1$, we introduce the Banach spaces

$$L_{f}^{q}(\Omega)= \biggl\{ u\in L^{1}_{\mathrm{loc}}( \Omega): \int_{\Omega} f(x)|u|^{q}\,dx< \infty \biggr\} $$

equipped with the norms

$$\|u\|_{f,q}= \biggl( \int_{\Omega} f(x)|u|^{q}\,dx \biggr)^{\frac{1}{q}} $$

and

$$L_{h}^{r}(\Omega)= \biggl\{ u\in L^{1}_{\mathrm{loc}}( \Omega): \int_{\Omega} h(x)|u|^{r}\,dx< \infty \biggr\} $$

equipped with the norm

$$\|u\|_{h,r}= \biggl( \int_{\Omega} h(x)|u|^{r}\,dx \biggr)^{\frac{1}{r}}. $$

Lemma 2.2

Assume that $1\leq r, q<2^{*}_{s}$, $f\in L^{\frac {2_{s}^{*}}{2_{s}^{*}-q}}(\Omega)$, and $h\in L^{\frac {2_{s}^{*}}{2_{s}^{*}-r}}(\Omega)$. Then we have the compact embeddings

$$E\hookrightarrow L^{r}_{h}(\Omega) $$

and

$$E\hookrightarrow L^{q}_{f}(\Omega), $$

and there exist constants $C_{h}$ and $C_{f}$ such that

$$\|u\|_{h,r}\leq C_{h}\|u\|_{E} $$

and

$$\|u\|_{f,q}\leq C_{f}\|u\|_{E}. $$

The lemma can be proved similarly as Theorem 2.1 in [1], which we will not repeat here.

Now, in view of the previous considerations, we have the definition of weak solution to problem (${P}_{\lambda }$).

Definition 2.1

We say that $u\in E$ is a weak solution to problem (${P}_{\lambda }$) if

$$\begin{aligned} & \iint_{\mathbb{R}^{2N}} \frac{(u(x)-u(y))(\varphi(x)-\varphi(y))}{|x-y|^{N+2s}}\,dx\,dy+ \int_{\Omega}v(x) u(x)\varphi(x)\,dx \\ &\quad =\lambda \int_{\Omega} f(x)|u|^{q-2}u\varphi \,dx- \int _{\Omega}h(x)g(x,u)\varphi \,dx \end{aligned}$$

(2.1)

for every $\varphi\in E$.

Finally, let us recall an inequality that we will use afterward.

Lemma 2.3

(see [1])

For any $k_{1}>0$, $k_{2}>0$, and $0<\eta<\beta$, we have

$$ k_{1}|t|^{\eta}-k_{2}|t|^{\beta} \leq k_{1} \biggl(\frac {k_{1}}{k_{2}} \biggr)^{\frac{\eta}{\beta-\eta}} \quad \textit{for all }t\in \mathbb{R}. $$

(2.2)

3 Proof of Theorem 1.1

The weak solutions of (${P}_{\lambda }$) correspond to the critical points of the energy functional $\Psi:E\rightarrow\mathbb{R}$ given by

$$\begin{aligned} \Psi(u)&=\frac{1}{2} \iint_{\mathbb{R}^{2N}} \frac{|u(x)-u(y)|^{2}}{|x-y|^{N+2s}}\,dx\,dy+\frac{1}{2} \int_{\Omega}v(x) u^{2}\,dx \\ &\quad {}-\frac{\lambda}{q} \int_{\Omega} f(x)|u|^{q}\,dx+ \int_{\Omega}h(x)G(x,u)\,dx, \end{aligned}$$

(3.1)

where

$$G(x,t)= \int^{t}_{0}g(x,\tau)\,d\tau. $$

By condition (H₁) we deduce

$$ \frac{b_{1}}{r}|t|^{r}\leq G(x,t)\leq \frac{b_{2}}{r}|t|^{r}\quad \mbox{for a.e. } x\in\Omega\mbox{ and all } t\in\mathbb{R}. $$

(3.2)

3.1 Nonexistence of solutions

Let $\lambda_{0}=\inf\{\lambda\in\mathbb{R}: \mbox{problem (${P}_{\lambda }$) admits at least a nontrivial solution}\}$. Then $\lambda_{0}$ exists (see Sect. 3.2), and $\lambda_{0}\geq0$. Indeed, assuming that $u\in E$ is a nontrivial solution of problem (${P}_{\lambda }$) and taking the test function $\varphi=u$ in (2.1), we have

$$0< \|u\|^{2}_{E}+ \int_{\Omega}h(x)g(x,u)u\,dx =\lambda \int_{\Omega}f(x)|u|^{q}\,dx, $$

which implies $\lambda>0$. Thus $\lambda_{0}\geq0$, and the proof of (i) is completed.

3.2 Existence of solutions

From now on, assume that $\lambda>0$ and denote $u^{+}=\max\{u,0\}$ and $u^{-}=\max\{-u,0\}$. We consider the following “positive” and “negative” truncations of the functional Ψ:

$$\Psi_{+}(u)=\frac{1}{2}\|u\|^{2}_{E}- \frac{\lambda}{q} \int_{\Omega}f(x) \bigl\vert u^{+} \bigr\vert ^{q}\,dx+ \int_{\Omega}h(x)G\bigl(x,u^{+}\bigr)\,dx $$

and

$$\Psi_{-}(u)=\frac{1}{2}\|u\|^{2}_{E}- \frac{\lambda}{q} \int_{\Omega}f(x) \bigl\vert u^{-} \bigr\vert ^{q}\,dx+ \int_{\Omega}h(x)G\bigl(x,-u^{-}\bigr)\,dx $$

for $u\in E$.

Obviously, if u is a critical point of functional $\Psi_{+}$, then for all $\varphi\in E$, we have

$$ \langle u,\varphi\rangle_{E}- \lambda \int_{\Omega}f(x) \bigl\vert u^{+} \bigr\vert ^{q-2}u^{+}\varphi \,dx + \int_{\Omega }h(x)g\bigl(x,u^{+}\bigr)\varphi \,dx=0, $$

(3.3)

whereas if u is a critical point of $\Psi_{-}$, then for all $\varphi \in E$, we have

$$ \langle u,\varphi\rangle_{E}- \lambda \int_{\Omega} f(x) \bigl\vert u^{-} \bigr\vert ^{q-2}\bigl(-u^{-}\bigr)\varphi \,dx + \int_{\Omega }h(x)g\bigl(x,-u^{-}\bigr)\varphi \,dx=0. $$

(3.4)

Step 1. We prove that there exist a nonnegative critical point $u_{1}$ for the functional $\Psi_{+}$ and a nonpositive critical point $u_{2}$ for the functional $\Psi_{-}$.

Let us first focus on the functional $\Psi_{+}$. We have the following lemma.

Lemma 3.1

The functional $\Psi_{+}$ is coercive and weakly lower semicontinuous in E.

Proof

For any $u\in E$, from (3.2) we have that

$$ \Psi_{+}(u)\geq\frac{1}{2}\|u\|^{2}_{E}- \frac{\lambda}{q} \int_{\Omega}f(x) \bigl\vert u^{+} \bigr\vert ^{q}\,dx+\frac{b_{1}}{r} \int _{\Omega} h(x) \bigl\vert u^{+} \bigr\vert ^{r}\,dx. $$

(3.5)

Taking $k_{1}=\frac{\lambda f(x)}{q}$, $k_{2}=\frac{b_{1}h(x)}{r}$, $\eta =q$, $\beta=r$, and $t=u^{+}$ in Lemma 2.3 and integrating over Ω, we obtain

$$ \int_{\Omega} \biggl(\frac{\lambda f(x)}{q} \bigl\vert u^{+} \bigr\vert ^{q}-\frac {b_{1}h(x)}{r} \bigl\vert u^{+} \bigr\vert ^{r} \biggr)\,dx\leq \biggl( \frac{\lambda}{q} \biggr)^{\frac{r}{r-q}} \biggl(\frac {r}{b_{1}} \biggr)^{\frac{q}{r-q}} \int_{\Omega} \biggl(\frac{f^{r}}{h^{q}} \biggr)^{\frac{1}{r-q}}\,dx. $$

It follows from (1.3) that

$$\frac{\lambda}{q} \bigl\Vert u^{+} \bigr\Vert ^{q}_{f,q}-\frac{b_{1}}{r} \bigl\Vert u^{+} \bigr\Vert ^{r}_{h,r}\leq C_{1}, $$

where $C_{1}=C_{1}(\lambda,r,q,f,h)$ is a constant. Hence $\Psi_{+}(u)\geq\frac{1}{2}\|u\|^{2}_{E}-C_{1}$, that is, $\Psi_{+}$ is coercive in E.

On the other hand, let $\{u_{n}\}\subset E$ and $u\in E$ satisfy $u_{n}\rightarrow u$ in E as $n\rightarrow\infty$. The compact embeddings $E\hookrightarrow L^{q}_{f}(\Omega),L^{r}_{h}(\Omega)$ and (3.2) yield

$$\int_{\Omega}f(x) \bigl\vert u_{n}^{+} \bigr\vert ^{q}\,dx\rightarrow \int_{\Omega}f(x) \bigl\vert u^{+} \bigr\vert ^{q}\,dx $$

and

$$\int_{\Omega}h(x)G\bigl(x,u_{n}^{+}\bigr)\,dx \rightarrow \int_{\Omega}h(x)G\bigl(x,u^{+}\bigr)\,dx $$

as $n\rightarrow\infty$, which imply that $\Psi_{+}$ is a continuous functional from E to $\mathbb{R}$. The convexity of $\Psi_{+}$ is trivial. Therefore $\Psi_{+}$ is weakly lower semicontinuous in E. □

By the Weierstrass theorem we deduce that the functional $\Psi_{+}$ has a global minimizer in E, say $u_{1}$, that is,

$$\Psi_{+}(u_{1})=\inf_{u\in E} \Psi_{+}(u). $$

Then, $u_{1}$ satisfies the definition of weak solution (3.3). Choosing $u_{1}^{-}\in E$ as a test function, we find

$$\begin{aligned} & \iint_{\mathbb{R}^{2N}} \frac{(u_{1}(x)-u_{1}(y))(u_{1}^{-}(x)-u_{1}^{-}(y))}{|x-y|^{N+2s}}\,dx\,dy+ \int _{\Omega}v(x) u_{1}(x)u_{1}^{-}(x) \,dx \\ &\quad {}- \lambda \int_{\Omega} f(x) \bigl\vert u_{1}^{+} \bigr\vert ^{q-2}u_{1}^{+}u_{1}^{-} \,dx - \int _{\Omega}h(x)g\bigl(x,u_{1}^{+} \bigr)u_{1}^{-} \,dx=0. \end{aligned}$$

(3.6)

By the elementary inequality

$$(a-b) \bigl(a^{-}-b^{-}\bigr)\leq-\bigl(a^{-}-b^{-}\bigr)^{2}, $$

from (3.6) we have that

$$\iint_{\mathbb{R}^{2N}} \frac{(u_{1}^{-}(x)-u_{1}^{-}(y))^{2}}{|x-y|^{N+2s}}\,dx\,dy+ \int_{\Omega }v(x) \bigl\vert u_{1}^{-} \bigr\vert ^{2} \,dx\leq0, $$

which implies that $u_{1}^{-}=0$, that is, $u_{1}\geq0$ a.e. in Ω. Hence $u_{1}$ is a weak solution of (${P}_{\lambda }$).

We may apply similar arguments to prove that the functional $\Psi_{-}$ has a minimizer in E, that is, that there exists $u_{2}\in E$ such that $\Psi_{-}(u_{2})=\inf_{u\in E}\Psi_{-}(u)$. Moreover, we can proceed with $\varphi=u_{2}^{+}$ similarly as in (3.4). Noting that $(a-b)(a^{+}-b^{+})\geq(a^{+}-b^{+})^{2}$, we get that $u_{2}\leq 0$ a.e. in Ω and that $u_{2}$ is also a weak solution of (${P}_{\lambda }$).

Step 2. We show that if λ is large enough, then $u_{1}$ and $u_{2}$ are nontrivial with $\Psi(u_{1})<0$ and $\Psi(u_{2})<0$.

Define

$$\lambda_{+}=\inf_{ \substack{ u\in E\\\|u^{+}\|_{f,q}=1}} \biggl\{ \frac{q}{2} \|u\|^{2}_{E}+q \int_{\Omega}h(x)G\bigl(x,u^{+}\bigr)\,dx \biggr\} . $$

Let $\lambda>\lambda_{+}$. Then there exists a function $u_{0}\in E$ with $\|u^{+}_{0}\|_{f,q}=1$ such that

$$\lambda \bigl\Vert u^{+}_{0} \bigr\Vert ^{q}_{f,q}=\lambda>\frac{q}{2} \Vert u_{0} \Vert ^{2}_{E}+q \int _{\Omega}h(x)G\bigl(x,u_{0}^{+}\bigr) \,dx\geq\lambda_{+}. $$

This inequality implies that

$$\Psi_{+}(u_{0})=\frac{1}{2}\|u_{0} \|^{2}_{E}-\frac{\lambda}{ q} \int_{\Omega}f(x) \bigl\vert u^{+}_{0} \bigr\vert ^{q}\,dx+ \int_{\Omega}h(x)G\bigl(x,u^{+}_{0}\bigr) \,dx< 0, $$

and consequently

$$\Psi(u_{1})=\Psi_{+}(u_{1})=\inf _{u\in E}\Psi_{+}(u)< 0; $$

in other words, $u_{1}$ is nontrivial.

In the same way, define

$$\lambda_{-}=\inf_{ \substack{ u\in E\\\|u^{-}\|_{f,q}=1} } \biggl\{ \frac{q}{2} \|u\|^{2}_{E}+q \int_{\Omega}h(x)G\bigl(x,-u^{-}\bigr)\,dx \biggr\} . $$

If $\lambda>\lambda_{-}$, then it follows that $u_{2}$ is nontrivial with $\Psi(u_{2})=\Psi_{-}(u_{2})<0$. So far, by the previous steps, we have showed that, for any $\lambda >\lambda_{+}$, problem (${P}_{\lambda }$) has a nontrivial positive solution $u_{1}$, whereas for any $\lambda>\lambda_{-}$, problem (${P}_{\lambda }$) has a nontrivial negative solution $u_{2}$.

Step 3. Now, let

$$\lambda_{+}^{*}=\inf \bigl\{ \lambda\in\mathbb{R}: \mbox{problem (${P}_{\lambda }$) has at least one nontrivial positive solution} \bigr\} . $$

Clearly, $0\leq\lambda_{+}^{*}\leq\lambda_{+}$.

Lemma 3.2

For any $\lambda>\lambda_{+}^{*}$, (${P}_{\lambda }$) admits at least one nontrivial positive solution.

Proof

Fix $\lambda>\lambda_{+}^{*}$. By the definition of $\lambda_{+}^{*}$, there exists $\mu\in(\lambda_{+}^{*},\lambda)$ such that ($P_{\mu}$) has a nontrivial solution $u_{\mu}\in E$ with $u_{\mu}>0$ in Ω. Obviously, $u_{\mu}$ is a sub-solution of (${P}_{\lambda }$).

On the other hand, consider the minimization problem

$$\inf_{u\in K(u_{\mu})}\Psi(u), $$

where $K(u_{\mu})=\{u\in E:u\geq u_{\mu}\}$. Note that $K(u_{\mu})$ is closed and convex and in turn also weakly closed. By Theorem 6.11 of [32], $\Psi(u)$ attains its infimum in $K(u_{\mu})$, that is, there exists $\tilde{u}\geq u_{\mu}$ such that $\Psi(\tilde{u})=\inf_{u\in K(u_{\mu})}\Psi(u)$, which also solves the variational inequality

$$\textstyle\begin{cases} \tilde{u}\in K(u_{\mu}), \\ \Psi'(\tilde{u})(\zeta-\tilde{u})\geq0 \quad \text{for all } \zeta \in K(u_{\mu}). \end{cases} $$

Choosing $\zeta=\tilde{u}+\varphi$ with $\varphi\geq0$ in E, we obtain

$$\langle\tilde{u},\varphi\rangle_{E}\geq\lambda \int_{\Omega }f(x)|\tilde{u}|^{q-2}\tilde{u}\varphi \,dx- \int_{\Omega }h(x)g(x,\tilde{u})\varphi \,dx, $$

that is, ũ is a supersolution to problem (${P}_{\lambda }$) that dominates $u_{\mu}$.

Thus by the maximum principle (see [33], Lemma 5.2) we get the existence of a nontrivial positive solution u of (${P}_{\lambda }$) with $u_{\mu}\leq u\leq\tilde{u}$. □

Let

$$\lambda_{-}^{*}=\inf\bigl\{ \lambda\in\mathbb{R}: \mbox{problem (${P}_{\lambda }$) has at least one nontrivial negative solution}\bigr\} . $$

We can proceed similarly to prove that, for any $\lambda>\lambda _{-}^{*}$, (${P}_{\lambda }$) admits at least one nontrivial negative solution.

Now, set

$$\lambda_{*}=\min\bigl\{ \lambda_{+}^{*}, \lambda_{-}^{*}\bigr\} $$

and

$$\lambda^{*}=\max\bigl\{ \lambda_{+}^{*}, \lambda_{-}^{*}\bigr\} . $$

We can see that $\lambda_{0}$ exists and $\lambda^{*}\geq\lambda_{*}\geq \lambda_{0}\geq0$, which completes the proof of the last two statements.

4 Proof of Theorem 1.2

4.1 The proof of statement (i)

First, if $q>2$, under the weaker assumption ($\mathrm{H}_{2}'$), the number $\lambda_{0}>0$. In fact, if $u\in E$ is a nontrivial solution of problem (${P}_{\lambda }$), then taking $\varphi=u$ in (2.1), from (1.2) we have that

$$\begin{aligned} \|u\|^{2}_{E}&=\lambda \int_{\Omega}f(x)|u|^{q}\,dx- \int_{\Omega }h(x)g(x,u)u\,dx \\ &\leq\lambda \int_{\Omega}f(x)|u|^{q}\,dx-b_{1} \int_{\Omega}h(x)|u|^{r}\,dx. \end{aligned}$$

(4.1)

Letting $k_{1}=\lambda f(x)$, $k_{2}=b_{1}h(x)$, $\eta=q-2$, $\beta=r-2$, and $t=u$ in Lemma 2.3, we get that

$$ \lambda f(x)|u|^{q-2}-b_{1}h(x)|u|^{r-2} \leq\lambda^{\frac{r-2}{r-q}} \biggl(\frac{1}{b_{1}} \biggr)^{\frac{q-2}{r-q}} \biggl(\frac {f^{r-2}}{h^{q-2}} \biggr) ^{\frac{1}{r-q}}. $$

(4.2)

Then it follows from (4.1), (4.2), and Lemma 2.1 that

$$\begin{aligned} \|u\|^{2}_{E} &\leq\lambda^{\frac{r-2}{r-q}} \biggl( \frac{1}{b_{1}} \biggr)^{\frac {q-2}{r-q}} \int_{\Omega} \biggl(\frac{f^{r-2}}{h^{q-2}} \biggr)^{\frac {1}{r-q}} \vert u \vert ^{2}\,dx \\ &\leq C^{2}_{2^{*}_{s}} \lambda^{\frac{r-2}{r-q}} b_{1}^{\frac {2-q}{r-q}} \biggl\Vert \frac{f^{\frac{r-2}{r-q}}}{h^{\frac{q-2}{r-q}}} \biggr\Vert _{L^{\frac{N}{2s}}(\Omega)} \Vert u \Vert ^{2}_{E}. \end{aligned}$$

Thus

$$\biggl(1-C^{2}_{2^{*}_{s}} \lambda^{\frac{r-2}{r-q}} b_{1}^{\frac {2-q}{r-q}} \biggl\Vert \frac{f^{\frac{r-2}{r-q}}}{h^{\frac{q-2}{r-q}}} \biggr\Vert _{L^{\frac{N}{2s}}(\Omega)} \biggr) \Vert u \Vert ^{2}_{E}\leq0, $$

which implies that

$$\lambda\geq \biggl(C^{2}_{2^{*}_{s}} b_{1}^{\frac{2-q}{r-q}} \biggl\Vert \frac {f^{\frac{r-2}{r-q}}}{h^{\frac{q-2}{r-q}}} \biggr\Vert _{L^{\frac{N}{2s}}(\Omega)} \biggr) ^{\frac{q-r}{r-2}}=M_{0}>0. $$

Then $\lambda_{0}\geq M_{0}>0$.

In addition, since (H₂) is replaced by a weaker assumption ($\mathrm{H}_{2}'$), the proof of Theorem 1.1 becomes more complicated. The treatment of coercivity of the functional $\Psi _{\pm}$ has to be adapted. Indeed, for any $\delta>0$ and $M>0$, we can decompose $\Omega=X\cup Y\cup Z$ with measurable sets X, Y, Z defined as follows:

$$\textstyle\begin{cases} X =\{x\in\Omega:f(x)< M \mbox{ and } h(x)>\delta\}, \\ Y =\{x\in\Omega:f(x)< M \mbox{ and } h(x)\leq\delta\}, \\ Z =\{x\in\Omega:f(x)\geq M\}. \end{cases} $$

In Lemma 2.3, setting $t=u^{+}$, $k_{1}=\frac{\lambda f(x)}{q}$, $k_{2}=\frac {b_{1}h(x)}{r}$, $\eta=q$, and $\beta=r$ and integrating over X, we have

$$\begin{aligned} \int_{X} \biggl(\frac{\lambda f(x)}{q} \bigl\vert u^{+} \bigr\vert ^{q}-\frac {b_{1}h(x)}{r} \bigl\vert u^{+} \bigr\vert ^{r} \biggr)\,dx&\leq \biggl( \frac{\lambda}{q} \biggr)^{\frac{r}{r-q}} \biggl(\frac {r}{b_{1}} \biggr) ^{\frac{q}{r-q}} \int_{X} \biggl(\frac{f(x)^{r}}{ h(x)^{q}} \biggr)^{\frac{1}{r-q}}\,dx \\ &\leq C_{2}, \end{aligned}$$

(4.3)

where $C_{2}=C_{2}(M,\delta,\Omega,\lambda)$ is a constant.

Meanwhile, we apply (2.2) with $\eta=q-2$ and $\beta=r-2$ and integrate over $Y\cup Z$ to derive

$$\begin{aligned} & \int_{Y\cup Z} \biggl(\frac{\lambda f(x)}{q} \bigl\vert u^{+} \bigr\vert ^{q} -\frac{b_{1}h(x)}{r} \bigl\vert u^{+} \bigr\vert ^{r} \biggr)\,dx \\ &\quad \leq \biggl(\frac {\lambda}{q} \biggr)^{\frac{r-2}{r-q}} \biggl( \frac{r}{b_{1}} \biggr)^{\frac{q-2}{r-q}} \int_{Y\cup Z} \biggl(\frac{f^{r-2}}{h^{q-2}} \biggr)^{\frac{1}{r-q}} \bigl\vert u^{+} \bigr\vert ^{2}\,dx \\ &\quad \leq C^{2}_{2^{*}_{s}} \biggl(\frac{\lambda}{q} \biggr)^{\frac {r-2}{r-q}} \biggl(\frac{r}{b_{1}} \biggr)^{\frac{q-2}{r-q}} \biggl\Vert \frac{f^{\frac{r-2}{r-q}}}{h^{\frac{q-2}{r-q}}} \biggr\Vert _{L^{\frac{N}{2s}}(Y\cup Z)} \bigl\Vert u^{+} \bigr\Vert ^{2}_{E}. \end{aligned}$$

(4.4)

Since $f,h\in L^{1}_{\mathrm{loc}}(\Omega)$, this results in that $|Z|\rightarrow0$ as $M\rightarrow\infty$ and, for fixed M, $|Y|\rightarrow0$ as $\delta\rightarrow0$. Thus, for any $\varepsilon >0$, we can choose M sufficiently large and then δ sufficiently small such that

$$ C^{2}_{2^{*}_{s}} \biggl(\frac{\lambda}{q} \biggr)^{\frac{r-2}{r-q}} \biggl(\frac{r}{b_{1}} \biggr)^{\frac{q-2}{r-q}} \biggl\Vert \frac{f^{\frac{r-2}{r-q}}}{h^{\frac{q-2}{r-q}}} \biggr\Vert _{L^{\frac{N}{2s}}(Y\cup Z)} < \varepsilon. $$

(4.5)

Combining (4.3)–(4.5), we have

$$ \int_{\Omega} \biggl(\frac{\lambda f(x)}{q} \bigl\vert u^{+} \bigr\vert ^{q} -\frac {b_{1}h(x)}{r} \bigl\vert u^{+} \bigr\vert ^{r} \biggr)\,dx\leq C_{2}+ \varepsilon \bigl\Vert u^{+} \bigr\Vert ^{2}_{E}. $$

(4.6)

Since $u^{+}=\frac{|u|+u}{2}$, we get

$$\begin{aligned} & \iint_{\Omega}\frac {|u^{+}(x)-u^{+}(y)|^{2}}{|x-y|^{N+2s}}\,dx\,dy \\ &\quad = \iint_{\Omega}\frac{ \vert |u(x)|-|u(y)|+u(x)-u(y) \vert ^{2}}{2^{2}|x-y|^{N+2s}}\,dx\,dy \\ &\quad \leq \iint_{\Omega}\frac{|u(x)-u(y)|^{2}}{|x-y|^{N+2s}}\,dx\,dy. \end{aligned}$$

Furthermore, since $\int_{\Omega}v(x) |u^{+}(x)|^{2}\,dx\leq\int_{\Omega}v(x) |u(x)|^{2}\,dx$, it follows that

$$ \bigl\Vert u^{+} \bigr\Vert ^{2}_{E} \leq \Vert u \Vert ^{2}_{E}. $$

(4.7)

Taking $\varepsilon=\frac{1}{4}$ in (4.6) and using (4.7), we obtain

$$\Psi_{+}(u)\geq\frac{1}{4} \Vert u \Vert ^{2}_{E}-C_{2}. $$

Thus $\Psi_{+}(u)$ is coercive in E. In the same way, $\Psi_{-}(u)$ is also coercive in E.

So far, all the necessary conditions are satisfied, and we can follow the same lines as in Sect. 3 to get the results of Theorem 1.1.

4.2 The cases $\lambda=\lambda_{0},\lambda_{*},\lambda^{*}$

For $\lambda=\lambda_{0}$, let $\{\lambda_{n}\}$ be a decreasing sequence converging to $\lambda_{0}$, and let $\{u_{n}\}$ be a corresponding sequence of solutions to problems $\{P_{\lambda_{n}}\}$. By (4.6) we get

$$\frac{\lambda_{n}}{q} \int_{\Omega}f(x) \vert u_{n} \vert ^{q} \,dx-\frac {b_{1}}{r} \int_{\Omega}h(x) \vert u_{n} \vert ^{r} \,dx\leq C_{2n}+\varepsilon \Vert u_{n} \Vert ^{2}_{E}, $$

where $C_{2n}=C_{2}(M,\delta,\Omega,\lambda_{n})>0$. Then

$$\begin{aligned} \Vert u_{n} \Vert ^{2}_{E}&\leq \lambda_{n} \int_{\Omega}f(x) \vert u_{n} \vert ^{q} \,dx-b_{1} \int_{\Omega}h(x) \vert u_{n} \vert ^{r} \,dx \\ &\leq\frac{b_{1}q}{r} \int_{\Omega}h(x) \vert u_{n} \vert ^{r} \,dx+qC_{2n}+q\varepsilon \Vert u_{n} \Vert ^{2}_{E} -b_{1} \int_{\Omega}h(x) \vert u_{n} \vert ^{r} \,dx \\ &=\frac {b_{1}(q-r)}{r} \int_{\Omega}h(x) \vert u_{n} \vert ^{r} \,dx+qC_{2n}+q\varepsilon \Vert u_{n} \Vert ^{2}_{E} \\ &\leq qC_{2n}+q\varepsilon \Vert u_{n} \Vert ^{2}_{E}. \end{aligned}$$

Setting $\varepsilon=\frac{1}{2q}$, we obtain

$$\Vert u_{n} \Vert ^{2}_{E} \leq2qC_{2n}. $$

Since $\{\lambda_{n}\}$ is bounded, it follows that $C_{2n}$ is bounded by a constant independent of n. Thus by Lemma 2.1 and 2.2, there exist a subsequence of $\{u_{n}\}$, still denoted by $\{u_{n}\}$, and $u_{\lambda_{0}}\in E$ such that

Since $u_{n}$ are solutions of ($P_{\lambda_{n}}$), for all $\varphi\in E$, we have

$$\langle u_{n},\varphi\rangle_{E}- \lambda_{n} \int_{\Omega} f(x) \vert u_{n} \vert ^{q-2}u_{n}\varphi \,dx - \int_{\Omega}h(x)g(x,u_{n})\varphi \,dx=0. $$

Passing to the limit as $n\rightarrow\infty$, we deduce that $u_{\lambda _{0}}$ solves problem ($P_{\lambda_{0}}$).

We finally claim that $u_{\lambda_{0}}\not\equiv0$. Indeed, taking $\varphi=u_{\lambda_{0}}$ in the definition of weak solution for $u_{\lambda_{0}}$, we have from (1.2) and Lemma 2.2 that

$$\begin{aligned} \|u_{\lambda_{0}}\|^{2}_{E}&\leq\lambda_{0} \|u_{\lambda_{0}}\|_{f}^{q}-b_{1} \|u_{\lambda_{0}}\|^{r}_{h} \\ &\leq\lambda_{0}\|u_{\lambda_{0}}\|_{f}^{q} \leq\lambda_{0}C_{f}\| u_{\lambda_{0}}\|^{q}_{E}. \end{aligned}$$

Taking into account that $q>2$, we obtain

$$\Vert u_{\lambda_{0}} \Vert _{E}\geq \biggl(\frac{1}{\lambda _{0}C_{f}} \biggr) ^{\frac{1}{q-2}}>0, $$

which implies $u_{\lambda_{0}}\not\equiv0$. Hence problem ($P_{\lambda_{0}}$) admits at least one nontrivial solution.

For $\lambda=\lambda_{*}$, without loss of generality, we can assume that $\lambda_{*}=\lambda_{+}^{*}<\lambda_{-}^{*}$. Then there also exists a decreasing sequence $\{\lambda_{n}\}$ converging to $\lambda _{*}$. Let $u_{n}\in E$ be a nontrivial positive solution of problem ($P_{\lambda_{n}}$). It suffices to repeat the previous arguments to conclude that ($P_{\lambda_{*}}$) has at least one nontrivial positive solution.

For $\lambda=\lambda^{*}$, assuming that $\lambda^{*}=\lambda _{+}^{*}>\lambda_{-}^{*}$, $\{P_{\lambda_{*}}\}$ admits at least one nontrivial positive solution. Furthermore, since $\lambda ^{*}>\lambda_{-}^{*}$, we deduce that $\{P_{\lambda_{*}}\}$ also admits a nontrivial negative solution. So, the second statement of Theorem 1.2 follows.

4.3 The case $\lambda\geq\tilde{\lambda}$

Let

$$\tilde{\lambda}=\max\{\lambda_{+},\lambda_{-}\}. $$

For $\lambda>\tilde{\lambda}$, we already know that Ψ has two nontrivial critical points $u_{1}\geq0$ and $u_{2}\leq0$. Now let us show that if $q>2$, then (${P}_{\lambda }$) has two additional nontrivial solutions.

Lemma 4.1

There exist $\rho\in(0,\|u_{1}\|_{E})$ and $\alpha>0$ such that $\Psi _{+}(u)\geq\alpha$ for all $u\in E$ with $\|u\|_{E}=\rho$.

Proof

Since $h(x)G(x,\cdot)\geq0$ in Ω, we have

$$\begin{aligned} \Psi_{+}(u)&=\frac{1}{2} \Vert u \Vert ^{2}_{E}- \frac{\lambda}{q} \int_{\Omega}f(x) \bigl\vert u^{+} \bigr\vert ^{q}\,dx+ \int_{\Omega }h(x)G\bigl(x,u^{+}\bigr)\,dx \\ &\geq\frac{1}{2} \Vert u \Vert ^{2}_{E}- \frac{\lambda}{q} \bigl\Vert u^{+} \bigr\Vert ^{q}_{f,q} \\ &\geq\frac{1}{2} \Vert u \Vert ^{2}_{E}- \frac{\lambda}{q} \Vert u \Vert ^{q}_{f,q}. \end{aligned}$$

From Lemma 2.2 we see that

$$\begin{aligned} \Psi_{+}(u)&\geq\frac{1}{2} \Vert u \Vert ^{2}_{E}- \frac{\lambda}{q}C_{f} \Vert u \Vert ^{q}_{E} \\ &= \Vert u \Vert ^{2}_{E} \biggl(\frac{1}{2}- \frac{\lambda}{q}C_{f} \Vert u \Vert ^{q-2}_{E} \biggr) \\ &=\rho^{2} \biggl(\frac{1}{2}-\frac{\lambda}{q}C_{f} \rho^{q-2} \biggr). \end{aligned}$$

Take $0<\rho<\min \{ \Vert u_{1} \Vert _{E}, (\frac {q}{2C_{f}\lambda} ) ^{\frac{1}{q-2}} \}$. Then

$$\alpha=\rho^{2} \biggl(\frac{1}{2}-\frac{\lambda}{q}C_{f} \rho^{q-2} \biggr)>0 $$

satisfies the statement. □

Next, we prove that the Palais–Smale condition holds for every sequence $\{u_{n} \}\subset E$.

Lemma 4.2

Assume that a sequence $\{u_{n} \}\subset E$ such that $\{\Psi _{+}(u_{n})\}$ is bounded and $\Psi'_{+}(u_{n})\rightarrow0$ in $E^{*}$ as $n\rightarrow\infty$. Then $\{u_{n}\}$ has a convergent subsequence in E.

Proof

Since $\Psi_{+}$ is coercive, we have that $\{u_{n} \}$ is bounded in E. It is possible to extract a sequence, still relabeled by $\{u_{n}\}$, such that $\{u_{n}\}$ converges weakly to some u in E. By Lemma 2.2 we obtain

$$ u_{n}\rightarrow u \quad \mbox{in } L^{q}_{f}(\Omega)\quad \mbox{and}\quad u_{n} \rightarrow u \quad \mbox{in } L^{r}_{h}(\Omega). $$

(4.8)

Then $\{u_{n}\}$ is bounded in $L^{q}_{f}(\Omega)$ and $L^{r}_{h}(\Omega )$ with $\|u_{n}\|_{f,q}\leq C_{3}$ and $\|u_{n}\|_{h,r}\leq C_{4}$. Observe that

$$\begin{aligned} \Psi_{+}'(u_{n}) (u_{n}-u)&= \langle u_{n},u_{n}-u\rangle_{E}- \int _{\Omega}j\bigl(x,u_{n}^{+}\bigr) (u_{n}-u)\,dx \\ &=\langle u_{n},u_{n}\rangle_{E}-\langle u_{n},u\rangle_{E}- \int_{\Omega }j\bigl(x,u_{n}^{+}\bigr) (u_{n}-u)\,dx, \end{aligned}$$

(4.9)

where $j(x,u_{n}^{+})=\lambda f(x) \vert u_{n}^{+} \vert ^{q-2}u_{n}^{+}-h(x)g(x,u_{n}^{+})$. First, note that

$$\langle u_{n},u\rangle_{E} \rightarrow\langle u,u \rangle_{E}. $$

In addition, using Hölder’s inequality and claim (4.8), we have

$$\begin{aligned} \biggl\vert \int_{\Omega}j\bigl(x,u_{n}^{+}\bigr) (u_{n}-u)\,dx \biggr\vert &\leq\lambda C^{q-1}_{3} \Vert u_{n}-u \Vert _{f,q}+b_{2}C_{4}^{r-1} \Vert u_{n}-u \Vert _{h,r} \\ &\rightarrow0\quad \mbox{as } n\rightarrow\infty. \end{aligned}$$

Since $\Psi_{+}'(u_{n})(u_{n}-u)\rightarrow0$ as $n\rightarrow\infty$, passing to the limit in (4.9), we obtain $\Vert u_{n} \Vert _{E}\rightarrow \Vert u \Vert _{E}$ as $n\rightarrow\infty$. Therefore

$$\begin{aligned} & \Vert u_{n}-u \Vert _{E}^{2} \\ &\quad = \Vert u_{n} \Vert _{E}^{2}+ \Vert u \Vert _{E}^{2}-2 \iint_{\mathbb{R}^{2N}} \frac{(u_{n}(x)-u_{n}(y))(u(x)-u(y))}{|x-y|^{N+2s}}\,dx\,dy \\ &\qquad {} -2 \int_{\Omega}v(x) u_{n}(x)u(x)\,dx \\ &\quad \rightarrow2 \Vert u \Vert _{E}^{2}-2 \Vert u \Vert _{E}^{2}=0 \end{aligned}$$

as $n\rightarrow\infty$. Then the Palais–Smale condition holds. □

As a consequence, the mountain pass theorem guarantees the existence of a critical point $u_{3}$ for $\Psi_{+}$ with $\Psi_{+}(u_{3})\geq\alpha >0$, which implies that $u_{3}$ is nontrivial and different from $u_{1}$ and $u_{2}$. Moreover, working as we did for $u_{1}$, we can show that $u_{3}\geq0$. So, $u_{3}$ is a critical point of Ψ. The third nontrivial solution of problem (${P}_{\lambda }$) is obtained.

Similarly, we apply the mountain pass theorem to $\Psi_{-}$ to prove the existence of the fourth nontrivial weak solution of problem (${P}_{\lambda }$) having negative sign and different from the previous ones. Thus, when $\lambda>\tilde{\lambda}$, four nontrivial solutions have been obtained.

If $\lambda=\tilde{\lambda}$, then we can assume that $\tilde {\lambda}=\lambda_{+}>\lambda_{-}$. Let $\lambda_{n}=\tilde{\lambda }+\frac{1}{n}$. Then $\lambda_{n}\rightarrow\tilde{\lambda}$ as $n\rightarrow\infty$ and $\lambda_{n}>\tilde{\lambda}$ for $n\in\mathbb{N}_{+}$. So, for every $n\in\mathbb{N}_{+}$, there exist two nontrivial positive solutions $u_{n_{1}}$ and $u_{n_{2}}$ of problem ($P_{\lambda_{n}}$) with $\Psi(u_{n_{1}})<0$ and $\Psi(u_{n_{2}})\geq\alpha>0$. Proceeding as in Sect. 4.2, we get that there exist $u_{\tilde{\lambda}_{1}}\geq0$ and $u_{\tilde {\lambda}_{2}}\geq0$ such that $u_{n_{1}}\rightharpoonup u_{\tilde {\lambda}_{1}}$ in E and $u_{n_{2}}\rightharpoonup u_{\tilde {\lambda}_{2}}$ in E. Furthermore, we can verify that $u_{\tilde {\lambda}_{1}}$ and $u_{\tilde{\lambda}_{2}}$ are two weak solutions of problem ($P_{\tilde{\lambda}}$) with $\Psi ({u_{\tilde{\lambda}_{1}}})<0$ and $\Psi({u_{\tilde{\lambda }_{2}}})\geq\alpha>0$, which implies that $u_{\tilde{\lambda }_{1}}\neq u_{\tilde{\lambda}_{2}}$. On the other hand, since $\tilde{\lambda}>\lambda_{-}$, ($P_{\tilde{\lambda}}$) admits two different nontrivial negative solutions. Thus, for $\lambda=\tilde{\lambda}$, ($P_{\tilde{\lambda}}$) has at least four nontrivial solutions.